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ABSTRACT 


The  stability  analysis  of  a  class  of  non-linear  systems  is 
presented  in  this  thesis.  The  class  of  systems  are  those  which  can  be 
represented  by  vector  matrix  state  equations,  are  analytic  and  have  a 
non-linearity  (which  passes  through  the  origin) ,  in  the  feed-back  loop. 
Two  types  of  systems  are  considered,  the  first  is  a  continuous  system, 
the  second  has  the  same  system  equation  but  is  considered  from  the 
sampled  data  point  of  view?  with  and  without  zero  order  hold.  Non-zero 
initial  conditions  are  considered  from  the  outset  and  inter-sample 
stability  in  the  case  of  the  sampled  data  systems  is  considered.  The 
determination  of  the  input-output  stability  bounds  is  approached  via  the 
Volterra  series,  whose  region  of  convergence  and  uniqueness  is  assured 
by  satisfying  the  Banach  contraction- mapping  principle.  Determination 
of  the  contraction  constant  is  achieved  via  the  Frechet  derivative. 
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CHAPTER  I 


INTRODUCTION 

Modern  technology  has  given  rise  to  today's  complex  systems  many  of 
which  are  only  describable  in  terms  of  non-linear  vector  differential 
equations?  the  suggestion  that  these  systems  can  be  analysed  for 
stability  by  the  application  of  straight-forward  methods,  applicable  to 
simpler  systems,  is  not  always  true.  Dimensionality  can  produce  problems 
which  had  not  been  considered  at  the  outset?  thus  more  sophisticated 
techniques  must  be  used  in  the  determination  of  system  stability. 

What  is  system  stability,  and  how  is  this  stability  determined? 

These  questions  are  of  paramount  importance  to  the  systems  engineer 
seeking  the  region  of  stability  meaningful  to  his  particular  problem. 

The  concept  of  stability  of  a  linear  system  with  constant 
coefficients  is  basic  to  control  engineering,  stability  as  defined  by 
Bower  and  Schultheiss ,  [i]+  is  that  a  linear  system  is  stable  if  and 
only  if  its  output  response  to  every  bounded  input  remains  bounded. 

Thus  a  linear  system  can  be  theoretically  stable  for  any  input 
regardless  of  size.  Such  is  not  the  case  for  non-linear  systems. 

The  stability  of  non-linear  systems  is  often  a  local  concept  and  is 
possibly  some  function  of  the  input.  The  definitions  of  non-linear 
system  stability  existing  in  the  literature  are  many,  some  of  which  are 
referenced  below.  The  list  is  by  no  means  exhaustive. 

(1)  Kalman  &  Bertram  [2]  have  given  eight  definitions  of  stability. 

(2)  Antosiewicz  [3]  has  nine  definitions. 

(3)  Ingwerson  [4]  gives  twenty  definitions. 

t  Numbers  placed  within  square  brackets  denote  references. 


1 


- 

' 


' 

i 

'  ' 

-  s  ... 

* 

. 


The  definition  of  stability  to  be  adopted  here  is  that  of  Zadeh  [5], 
that  a  bounded  set  of  inputs  gives  rise  to  a  bounded  set  of 
outputs ,  hereafter  called  B.I.B.O.  stability.  In  non-linear  systems, 
the  determination  of  the  exact  stability  boundary  is  extremely  difficult 
and  approximate  techniques  have,  since  the  early  1950s,  become  more 
apparent  in  the  literature.  It  is  instructive  to  trace  the  development 
of  what  is  now  called  "stability  analysis  via  the  Volterra  series". 

An  idea  was  conceived  by  the  mathematician  Volterra  [6]  of  creating 
a  general  theory  of  functions  which  depend  upon  a  continuous  set  of 
values  of  another  function.  This  theory  is  now  called  the  "Theory  of 
Functionals"/  a  name  coined  by  Hadamard.  The  theory  lay  virtually 
dormant  until  Wiener  (1942)  utilized  it  in  his  research,  Barrett 
utilizing  the  functional  power  series  (due  to  Volterra)  and  the  work 
accomplished  by  Wiener,  discussed  a  method  of  expanding  the  input  - 
output  relationship  of  a  non-linear  system  in  terms  of  a  functional 
power  series. 

It  was  not  until  the  late  1950s  and  early  1960s  however,  that  the 
potential  of  the  Volterra  series  was  realised. 

Brilliant  [7]  utilizing  Wiener's  effort  specified  the  conditions 
for  an  analytic  system.  Flake  [8]  showed  that  the  Volterra  series 
could  be  used  to  relate  the  input  to  the  output  of  a  non-linear  system. 
Barrett  [9]  demonstrated  Flake's  concept  by  using  Duffing' s  Equation  and 
by  utilizing  the  analytic  concept  of  Brilliant  he  proved  that 
the  resulting  Volterra  series  was  convergent.  The  convergence 
properties  were  directly  related  to  boundedness  and  stability  of  the 
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. 

j?$?  2. 

. 


3 


Christensen  [10]  then  proved  that  the  convergence  properties  of  the 
Volterra  series  were  obtainable  via  the  Banach  contraction  principle. 
Then,  by  further  application  of  the  contraction  principle  he  proved 
that  a  stable  region  could  be  found  in  the  Banach  space  under 
consideration,  this  space  contained  the  solutions  of  the  non-linear 
system  which  itself  exhibited  B.I.B.O.  stability  in  the  region  so 
determined.  Corroborative  evidence  was  now  established  between  the 
methods  displayed  by  Barrett  and  Christensen. 

Addition  of  initial  conditions,  uniqueness  of  the  Volterra  series 
and  a  larger  region  of  convergence  were  contributed  by  Trott  and 
Christensen  [34] ,  [33]  and  [11]  respectively. 

Applications  to  discrete  data  systems  was  made  by  Rashed  [12]  and 
Rao  [13] . 

To  date  the  most  significant  results  have  been  achieved  with 
systems  that  are  reducable  to  the  form  shown  below. 


output 

-> 


Figure  1:  Single  -  input/single  -  output  systems. 

Thus  the  extension  of  the  work  of  Christensen,  Trott,  Rao,  Rashed 
to  the  multivariable  system  is  the  next  logical  step. 
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This  thesis  will  extend  their  results  to  systems  expressible  as 
non-linear  vector  differential  equations.  The  extension  will  be  made 
via  the  contraction  mapping  principle  utilizing  the  Frechet  differential 
and  state-space  matrix  methods,  [15],  [24],  [26].  The  class  of  systems 
considered  here  will  contain  a  time  invariant  non-linearity  passing 
through  the  origin. 

Chapter  II  will  introduce  the  notation  and  mathematics  required  in 
the  sequel,  theorems  current  to  this  thesis  will  be  stated  and  proofs 
shown  where  necessary. 

In  Chapter  III  non-linear  system  equations  will  be  examined,  the 
region  of  stability  determined  by  (1)  reduction  of  the  system  equation 
to  standard  matrix  form,  and  (2)  by  reduction  of  the  system  equation  by 
Heaviside ' s  decomposition . 

The  methods  of  Chapter  III  will  be  extended  in  Chapter  IV  to  cover 


discrete  data  systems. 
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CHAPTER  II 


MATHEMATICAL  DERIVATIONS 

2 . 0  Introduction. 

The  mathematics  necessary  for  the  derivation  of  the  material 
required  in  the  sequel  is  presented  in  this  chapter.  The  object  is  not 
to  present  a  mathematical  treatise,  but  rather  the  material  necessary 
for  the  maintenance  of  continuity  once  the  development  of  the  core  of 
the  thesis  is.  underway.  Functions  representative  of  practical  systems 
are  considered  and  the  space  on  which  they  operate  is  a  Banach  space. 

Matrices  and  norms  have  an  important  role  in  the  ensuing 
mathematical  development.  It  is  impossible  to  study  multi -dimensional 
systems  in  a  meaningful  fashion  without  matrices ,  while  the  norm  is  one 
of  the  foundation  stones  of  functional  analysis. 

The  Frechet  (F)  derivative  is  approached  via  the  F  differential 
which  is  approached  via  the  Gateaux  (G)  differential.  A  pictorial 
representation  of  the  route  taken  in  the  development  of  the  F  derivative 
is  shown  in  Fig.  2,  Ortega  and  Rhe inbolt,  [19]. 
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F  differential 
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Figure  2:  Relationship  between  "F"  differential  and 

the  "F"  derivative 
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A  transformation  which  takes  a  domain  of  the  Banach  space  X  into 
itself  is  considered  and  a  contraction  of  the  transformation  will  exist 
in  the  domain,  if  the  following  conditions  are  satisfied  Hashed,  [18]: 

(1)  The  domain  is  invariant  under  the  transformation. 

(2)  The  norm  of  the  F  derivative  is  less  than  one. 

Some  of  the  questions  to  be  answered  in  this  chapter  are: 

(1)  What  are  the  existence  conditions  for  the  F  derivative. 

(2)  What  conditions  must  exist  for  an  operator  (mapping  function) 
to  be  continuous. 

(3)  Why  use  the  F  derivative. 

2.1  Functional  Representation. 

A  control  system  can  be  viewed  as  a  transformation  which  maps 
points  of  the  input  space  into  the  output  space.  The  process  is 
iterative.  The  existence  of  a  solution  and  the  method  of  obtaining  it 
will,  for  the  system  in  question,  depend  upon  the  transformation. 

Many  existence  theorems,  in  functional  analysis,  can  be  proved 
with  the  aid  of  the  Banach  contraction  -  mapping  principle.  Clearly 
the  determination  of  the  existence  of  a  solution  for  the  system  in 
question  via  the  contraction  -  mapping  principle  is  relevant  in  this 
context. 

Since  the  Banach  contraction  -  mapping  principle  forms  an  integral 
part  of  the  mathematical  development,  a  space  conducive  to  the  use  of 
the  principle  is  required.  This  space,  as  stated  in  the  introduction 
to  this  chapter,  is  a  Banach  space. 
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Definition  1:  A  "transformation",  (denoted  by  the  symbol  T  -  Gamma), 


is  a  function  defined  on  a  vector  space  which  takes  its  values  in 
another  vector  space  Y.  An  element  of  Y  is  called  an  image  of  x  e  X 
under  I\ 

Definition  2 :  An  "operator"  is  a  transformation  whose  domain  and  range 
lie  in  the  same  space . 

An  operator  will  also  be  denoted  by  r_. 

Definition  3 :  A  "space"  R  is  a  set  of  elements  f,  g,  h,  - ,  these 

elements  may  be  real  or  complex  numbers,  vectors,  matrices  or  functions 
of  one  or  more  variables. 

The  spaces  considered  here  are  linear. 

Definition  4:  A  "linear  space"  is  one  in  which  the  elements  of  the 
space  obey  the  laws  of  linearity. 

Definition  5:  A  "vector  space",  X,  consists  of  a  set  of  quantities 
x,  y,  - ,  (called  vectors) ,  and  two  operations. 

(1)  +  (plus)  defined  as  pointwise  addition. 

(2)  •  (multiplication)  defined  as  scalar  multiplication. 

The  space  is  closed  under  +  and  •  if  the  following  axioms  and  their 
combinations  are  satisfied: 


(a) 

(x 

+ 1) 

=  Z,  ¥  X ,  y_r  Z_,  £  X^ 

(b) 

cx 

e  X, 

V  x  e  X  and  all  c 

(2.1) 

(c) 

C0 

=  0 

is  the  null  vector. 
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A  linear  space  that  has  a  finite  algebraic  base  is  said  to  be 
finite  dimensional. 

Definition  6:  The  "dimension  n"  of  a  vector  space  is  the  number  of 
elements  in  a  basis .  Every  non-zero  finite  dimensional  vector  space  has 
a  basis. 

If  X.  is  a  finite  dimensional  vector  space  then  every  element  of  X_ 
can  be  represented  in  the  following  form: 


n 


(2.2) 


i=l 


where  the  x^s  form  the  algebraic  basis. 


Def intion  7 :  The  "norm"  (||  «||)  of  a  vector  is  a  mapping  from  the  vector 
space  X  to  R=E^  (the  space  of  real  numbers) ,  and  is  said  to  be  a 


functional  of  X.  To  be  a  norm,  the  functional  must  satisfy  the 


following  axioms  [21] -[26]: 


(a) 


¥  x  e  X 


|  x  ||  =  0  iff  x  =  0 


(2.3) 


(c) 


¥  x  e  X  and  ¥  c  e  E 


1 


(d)  II  2£  II  -  II  X  II  1  II  2i  "  Z  II  v  x ,  y  e  x 


. 
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By  inspection  of  (2.3)  it  can  be  seen  that  a  norm  is  not  a  linear 
functional,  but  because  of  (2.3(d))  it  is  a  continuous  functional. 

Thus  the  norm  is  a  continuous  functional,  but  it  is  not 
necessarily  linear.  Loosely  speaking,  the  norm  of  a  vector  is  a 
measure  of  its  "length";  similarly  the  norm  of  a  matrix  A  is  a 
measure  of  the  "size  of  A". 

The  norm  of  a  matrix  vector  product  occurs  frequently  throughout 
the  mathematical  development,  thus  (2.3)  will  be  augmented  by  an 
additional  condition  which  connects  matrix  and  vector  norms. 

To  a  given  vector  norm,  a  compatible  matrix  norm  is  defined  by: 


II  A  ||-  SUP 


(2.4) 


II 


X 


II 


thus 


Proof 


y  =  A  x  V  x,  y  e  X 


where  A  =  (a. . ) 

-  13 


n 


X  =  (x  ,  x2 


y.  =  (yv  y2, 


n 


thus 


j=l 


therefore 


n 


j=l 


(2.5) 


•  ' 
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The  supremum  norm  -  details  of  which  are  contained  in  [23]  -  is  used 
throughout. 

The  definitions  of  matrix  and  vector  norms  respectively  are: 


II 


(2.6) 


II  X  ||  =  sup  sup 
i  t 


xi(t) 


(2.7) 


Thus  (2.5)  can  be  rewritten  as 


n 

\ 

sup 

yi(t) 

<  sup 
i 

Vj=l 

*j (t)  ) 

(2.8) 


therefore, 

llxll  =  II** II  <11*11  II* II. 


(2.9) 


Thus  the  norms  chosen  are  compatible,  and  a  supplementary  condition  i.e. 
equation  (2.9)  can  be  included  in  (2.3). 

Definition  8:  An  operator  r_  mapping  a  normed  space  £  into  itself  is 
said  to  be  "bounded"  if  there  exists  a  constant  M<°°  such  that, 


|ll(x)  ||  <  M  ||x  ||  V  x  e  X . 


(2.10) 


Definition  9:  A  "Banach  space"  is  a  complete,  normed-linear  vector 
space.  A  space  is  complete  if  every  Cauchy  sequence  from  the  space  has 


its  limit  in  the  space. 


■  J 
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Definition  10;  A  bounded  operator  £,  which  maps  a  Banach  space  X 
into  itself,  is  said  to  satisfy  a  "Lipschitz  condition"  if, 

||r(x>  -  r(i)  ||  <  k  ||x  -  ^11 .  (2.ii) 

V  X,  Y,  ex 

where  o  <  K  <oo. 

If  K  <  la  contraction  condition  exists  on  £  i.e.  the  "distance" 
between  the  transformed  vectors  is  less  than  the  "distance"  between  the 
original  vectors. 

A  contraction  is  norm  dependent,  so  that  a  transformation  may  be  a 
contraction  in  one  norm  but  not  in  another.  However,  because  the  spaces 
being  considred  are  finite  dimensional  the  equivalent  norm  theorem. 
Porter  [16]  ,  will  hold.  Thus  a  contraction  under  one  norm  will  also  be 
a  contraction  under  a  different  norm. 

By  virtue  of  (2.3(d))  it  is  clear  that  (2.11)  demands  £  be 
continuous . 

Necessary  and  sufficient  conditions  for  £  to  be  continuous  are 
presented  in  section  2.3.  A  further  property  which  is  essential  to  the 
ensuing  mathematical  development  is  the  concept  of  convexity. 

Definition  11:  Let  D  c  £,  where  £  is  a  Banach  space.  If  £,  £  e  £  then 
the  "line  segment"  connecting  x  and  y_  is  a  subset  of  £  given  by 

{  z.  e  D :  £  =  a  x  +  3^./  a£o,  3£o,  a  +  3  =  l} 


which  is  a  statement  of  convexity. 


<> 


. 


The  spaces  considered  are  Banach  and  are  all  locally  convex  about 

some  point  x  e  D. 

— o  — 

Let  x  and  y_  be  vectors  contained  in  an  open  sphere  £  of  radius 
r  >  o,  centred  at  some  point  x  e  D.  Then 


x 


<  r 


and 


Hi  -  II  <  r. 


Estimating  the  "distance" from  ^  to  a  point  z  =  ax  +  By  on  the  line 
segment  connecting  x  and  yr  results  in 


ll£  -  2Eo  II  *  ||  d  -  3)  x  +  3^  -  Xo  || 

=  ||  (1  -  3)  (x  “  30  +  3(£  -  Xj)  || 

<  ||  (1  -  3)(x  -  x,)  ||  +  1 1  3 (y  -  x,)  II 

<  (1  -  3)  ||x  »  ||  +  3 \\y.  "  xjl 

<_  (1  -  3)  r  +  3r  =  r. 

Conclusion:  Any  point  on  the  line  segment  connecting  x  and  y_  belongs  to 
£.  Therefore,  the  whole  line  segment  belongs  to  D. 


Definition  12:  The  operator  F  is  said  to  be  "convex"  if  it  satisfies 


the  following  condition,  that  is, 


, 


e„U  Mb  nJ  I1  ►  o  it***'-*'  J  '  tl  •*  *  '  * 


, 
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clearly  from  defintions  7,  11  and  12,  it  is  seen  that  the  norm  is  a 
convex  functional . 

A  further  concept  which  will  be  utilized  in  the  sequel  is  the  one 
dimensional  intermediate  value  theorem.  The  difference  quotient  of 
differential  calculus  is  written  as 


f(x2)  -  f(x1) 


and  involves  the  values  of  the  function  for  distinct  values  of  x, 
whereas  the  derivative  of  the  function  at  a  point  gives  no  information 
about  the  function  at  other  points.  Principally  the  difference 
quotient  illustrates  the  properties  of  the  function  "in  the  large". 

The  derivative  illustrates  a  local  property,  that  is,  "in  the  small". 

Later  it  will  be  necessary  to  derive  global  properties  of  the 
function  i.e.  properties  over  the  whole  of  the  subspace,  from  the  local 
properties  of  the  derivative.  This  will  necessitate  using  the  inter¬ 
mediate  value  theorem. 

Intermediate  Value  Theorem;  If  f(x)  is  continuous  in  a  closed  interval, 
o  _<  x  x  +  h,  and  is  differentiable  at  every  point  of  the  open 
interval,  o  <  x  <  x  +  h,  then  there  exists  at  least  one  value  where 
o  <  X  <  1;  such  that 

f(x  +  h)  -  f (x)  fI(£) 

h 


where 


£  =  x  +  Xh. 


* 


. 


1 

■ 


The  functions  to  be  considered  in  the  succeeding  sections  are 
elements  of  the  space  of  continuous  functions  from  a  domain  of  Rn  into  Rn. 
This  space  is  called  a  "function  space"  and  is  written  as  C((S),  Rn) , 
where  S_cz  Rn . 

Let 

f  e  C((S) ,  Rn) 

and 

x(t)  e  C(  [a,  b]  ,  S) 

and  the  norm  of 

III.  II  =  sup  ||  f  (x(t) )  ||  . 

t  e  [a,  b] 
x  s  (S) 

Thus  the  function  space  is  modified  and  may  be  written  as 

£  (x(t))  e  C([a,  b] ,  (S) ,  Rn) 

where 

C([a,  b]  ,  (S)  ,  Rn)  =  (f^jc(t)):  f_  is  continuous 
on  a  domain  £  c  Rn  over  t  e  [a,  b] ,  into  Rn}  [17]  . 

2 . 2  The  Frechet  Differential 

The  differential  has,  by  itself,  influenced  the  development  of 
mathematics  more  than  any  other  single  concept.  It  is  one  of  the  most 
important  concepts  used  in  non-linear  systems  analysis.  A  differential 
can  play  more  than  one  major  role  significant  in  the  theory  and 
application  of  non-linear  functional  analysis,  Nashed  [18].  The  role 
of  major  interest  herein  is  that  of  the  local  approximation  of  non-linear 


operator  by  a  linear  operator. 


. 


’ 

_ 


Continuity  of  the  operator  is  one  of  the  prime  pre-requisites  for 
the  application  of  the  Banach  contraction  -  mapping  fixed  point  theorem, 
as  has  been  stated  in  section  2.1. 

In  elementary  calculus  the  concept  of  the  partial  derivative  is 
used  as  a  means  of  determining  the  derivative  of  a  multi-variable 
function;  each  co-ordinate  being  considered  separately. 

Definition  14:  If  x  =  (x, ,  x_,  — ■ — ,  x  )  and  y  =  (y..  ,  y_, - ,  y  )  are 

-  —  12  n  l  2.  n 

elements  of  a  vector  space  X_,  and  y_  differs  from  x  only  in  one 
co-ordinate  that  is  x^  =  y^  for  all  i  ^  j.  The  "partial  derivative"  of 
f  with  respect  to  the  jth  co-ordinate  is  written  as 


3f(x) 

3x . 

3 


lim 

y  .+X . 
3  3 


f(y)  -  f(x) 


Therefore,  the  total  differential  of  f  can  be  written  as 


(2.12) 


df 


3f  (x) 
3x . 


dx. 

3 


(2.13) 


It  is  well  known  that  functions  which  exist  in  are  continuous 
at  a  given  point  if  the  derivative  exists  at  that  point.  Ortega  [19] 
has  demonstrated  that  a  function  in  "n"  (n>l)  variables  can  have 
partial  derivatives  with  respect  to  each  of  its  variables  and  yet  still 
be  discontinuous.  Clearly  a  stronger  condition,  than  the  existence  of 
the  partials ,  is  required  to  imply  continuity  of  the  operator . 

A  stronger  condition  for  continuity  can  be  obtained  via  the 


directional  derivative. 


e  fa-:rt 


a  \ 


. 
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Definition  15:  A  function  f  is  defined  on  an  open  set  S_c  X_  and  x  e  S; 
assume  that  h  is  a  unit  vector  in  X.  The  "directional  derivative"  of  f 
at  the  point  x  in  the  direction  h  is  then 

lim  f(x  +  Ah)  -  f(x) 

X+o  - - - -  U.14 

A 

if  the  limit  exists. 

Since  h  is  completely  arbitrary,  (2.14)  must  contain  (2.12)  as  a 
special  case,  i.e.  a  specific  direction  is  considered. 

Definition  16:  An  "open  set"  S.  c  has  the  following  property: 

For  all  x  e  iS  there  exists  an  r  >  o  such  that  if  a  neighborhood 
N(jc,r)  is  erected  about  x,  and  £  e  N(x,r)  then  the  distance  between  \ 
jc  and  y_,  d(x,y_)<r. 

Let  e  =  r  -  d(jc,y)  then 
N (x, e)  c  N (x,r) . 

Open  sets  are  considered  for  the  following  reason.  For  all 
x  e  S  c  X  there  will  be  a  neighborhood  about  x  completely  contained  in 
S_,  i.e.  (N(sc,  •)c-S_.  Every  point  e  N(x, •)  can  be  written  in  the 
following  form:  =  x  +  ah,  where  h  e  X_  and  a  is  sufficiently  small 

such  that  x  +  ah  e  N (x , • ) .  Thus  one  sided  or  infinite  derivatives  can 
be  neglected. 

Further,  it  is  to  be  noted  that  no  restrictions  are  imposed  upon 
Y_  as  to  the  way  in  which  it  is  allowed  to  approach  sc.  Which  implies 
that  the  neighborhood  N  (sc ,  • )  must  be  convex. 

If  a  function  has  a  directional  derivative  in  every  h  e  X  then  all 
the  partials  must  exist.  Yet  the  function  may  be  discontinuous  at  the 


. 


4 


r.  • 

i.. 


r- 


given  point  [19] .  Thus  the  existence  of  all  the  partials  fails  to  imply 
continuity  at  the  point.  Clearly,  the  extension  of  a  system  from  n  =  1 
to  n  >  1  cannot  be  obtained  via  the  directional  derivative. 

A  generalization  of  the  directional  derivative ,  introduced  by 
Gateaux  (1913)  [19],  is  the  differential.  It  does  imply  continuity 
and,  at  the  same  time,  permits  the  extension  of  the  principal  theorems 
of  derivatives  from  dimensions  of  n  =  1  to  n  >  1. 

Definition  17:  A  function  Y_  maps  an  open  domain  S  of  a  vector  space  X 
into  another  vector  space  Y^,  i.e. 

r_:  S  c  X  -*  Y  . 

It  has  a  "differential"  at  x  e  S  if  there  exists  another  function  g 
which  satisfies  the  following  conditions: 

(1)  g  is  a  function  of  two  variables,  both  of  which  have  n 
dimensional  bases.  The  differential  of  F_  is  written  as  £(x;h) •  Where 
x  e  is  the  point  and  h  e  X  is  the  direction  under  consideration. 

(2)  g  is  homogeneous  in  h  and  of  degree  one. 

(3)  The  differential  must  exist.  It  must  be  noted  that  no 
guarantee  is  given  in  advance  that  £_  has  a  differential.  However,  if  £_ 
is  suitably  restricted  -  as  will  be  shown  later  -  then  g^  can  be  shown 
to  be  unique.  The  differential  of  r_  at  x.  in  the  direction  h_  can  also 
be  written  as 

g_(jc;h)  =  £'  (x_)h  ,  (2.15) 


where  T 1  is  the  derivative  of  T  at  x  and  T ' (x)  < 


00 


*■  /' 


V 


, 

' 


Definition  18:  The  "Gateaux  differential"  of  a  function  T:  x  +  Y  is 
written  as. 


D £(  x )  h  =  lim 
t+o 


£(x  +  th) 
 - 


f(x) 


I'  (ac)h. 


(2.16) 


if  the  limit  exists.  Where  Y  is  a  Banach  space,  but  X  need  not  be. 
Clearly  conditions  (1)  and  (3)  of  definition  17  are  satisfied.  Proof  of 
condition  (2),  definition  17,  is  now  presented,  that  is. 


DF(x) (Xh)  =  XDT(x)h. 


Proof : 

For  all  X  e  E',  replace  t  by  tX  in  (2.16)  then 


D£(x)h  =  lim 
t-K> 


r  (x  -  txh)  -  r_(x) 
tx~“ 


Y  D T(x)  (Xh)  . 


Conclusion: 

XD£(x)h  =  D£(x) (Xh) ,  (2.17) 

the  homogeneity  condition  is  satisfied. 

Definition  18  satisfies  all  the  conditions  stated  in  definition  17, 
i.e.  equation  (2.16)  is  valid.  Thus  a  function  r_ has  a  G  differential 
when  (2.16)  holds  in  every  direction.  Then  Dl^(x)  assigns  to  each  vector 
h  e  X_  a  vector  DF_(x) he Y,  therefore,  D£(x)  is  a  mapping. 

It  has  been  shown,  by  Ortega  and  Rheinbolt  [19]  ,  that  the 
G  differential  is  not  necessarily  a  linear  operator.  The  G  differential 
is  lacking  in  the  following  desirable  properties : 


(1)  it  is  not  necessarily  linear 


■rras  9ml  5 


' 

■ 


(2)  it  has  been  shown  by  Nashed  [18],  that  a  G  differential  can 
exist  and  be  a  continuous  linear  operator  while  the  function  itself  is 
discontinous . 

Clearly  then  a  stronger  form  of  differential  is  required  to  overcome 
these  deficiencies.  The  differential  now  to  be  considered  is  the  F 
differential. 


Definition  19:  A  mapping  r_:  D  c  X  Y  (where  D  is  an  open  domain  of  X) 

}C  and  Y  are  normed  real  vector  spaces;  r_  is  said  to  be  "F  differentiable" 
at  x  e  if  the  following  representation  holds  for  all 
h  e  X  3  x  +  h  £  D , 

Hx  +  h )  -  £(x_)  =  Mx)  h  +  w(x;  h)  .  (2.18) 

Where  Mx)  is  a  continuous  linear  operator  and  Mx)  :  2.  c  — 

Then  Mx)h  is  called  the  F  differential  of  £  at  x  and  is  written 

L(x)h  =  £'  (x)h  (2.19) 

Thus  r_'  (x)  e  L[x,  y]  ,  where  i[x,  y]  is  the  space  of  linear  operators 
which  take  a  domain  of  X_  into  Y^.  Since  the  spaces  X_  and  Y_  are  both 
normed  real  vector  spaces,  it  will  now  be  shown  that  if  the  F 
differential  exists  it  is  continuous. 

Substitute  (2.19)  into  (2.18)  and  take  the  norm  of  both  sides. 


r(x  +  h)  -  r  (x)  -  r1 (x)h 


Hull 


||w(x?  h)  || 

lilii 


(2.20) 


It  is  to  be  noted  here  that  w(x;  h)  Y  it  is  a  mapping,  dependent 


upon  two  n  dimensional  vectors  and  is  called  the  remainder  of  the 


i 


' 

- 

. 


differential.  The  map  is  defined  for  all  sufficiently  small  vectors 
h_  e  X(h  7*  9)  such  that 


lim  ||w(x;  h)  || 

-ll+°  l|h|| 


(2.21) 


The  limit  is  obviously  taken  for  |  |  h_  ||  ^  o,  otherwise  the  quotient  does 
not  make  sense. 

Then 


> 


lim  ||r(x  +  h) 

Ilk  lh°  I 


r(x)  -  £'  (x)h|| 

II 


o 


(2.22) 


which  is  an  alternative  method  of  defining  the  F  differential  [20] . 

Because  of  (2.21)  the  F  differential,  £'  OOh,  is  continuous.  The 
proof,  part  of  which  is  reproduced  from  Vainberg  [20]  will  now  be 
presented . 

Proof ;  £:  D.  c  £  y  and  if  T_  is  differentiable  at  some  x  e  D  then 
given  e  >  o  there  exists  N(x,  6).  such  that  if  x  +  h  e  N(x,  6)  ,  then 


|| £(x  +  h )  -  r(x)  -  £'  (x)h  ||  <_  e  ||h  ||  . 


(2.23) 


Let 


(2.24) 


where 


Y_  e  N(x,  6)  , 


' 

■ 


I  -  :•.  <  ■  'I 


now  apply  (2.3(d))  to  the  L.H.S  of  (2.23)  thus 


||r(x  +  h)  -  r(x)  II  -  || r*  (x)h|| 

<  ||r(x  +  h)  -  rw  -  £'  (x)h  || . 


(2.25) 


If  (2.25)  is  now  substituted  into  (2.23)  then 


II  r_(x  +  h)  -  r_(x)  ||  <_  e  ||h  ||  +  || £'  (x)h 


(2.26) 


<  e  h  +  r*(x)  h 


Now  substitute  (2.24)  into  (2.26)  and  write 


1 1 UX)  “  H*)  1 1  £  M  1 1 Z  -  2i 

where 

M  =  ||£'  (x)  ||  +  e  . 


Since 


then 


e  >  o,  let 


mm  (— ; 

M 


6)  . 


1 1  Hi)  -  £(x)||<  m| 

<  e  , 


when 

II y  -  ill i  . 


(2.27) 


(2.28) 


(2.29) 


(2.30) 


(2.31) 


Conclusion; 

Since  e  is  arbitrary  and  positive  this  implies  that  £_  is 
continuous,  and  because  of  (2.3(d))  this  implies  that  r'(x)h  is  also 


continuous . 


■ 


The  F  differential  is  utilized  because  it  satisfies  the  following 


conditions : 

(1)  the  F  differential  is  defined  in  norm,  thus  it  is  a  strong 
differential . 

(2)  if  the  F  differential  exists  then 

(a)  the  G  differential  exists 

(b)  r_  is  continuous 

(c)  the  derivative  is  unique 

(d)  the  derivative  is  a  continuous  linear  operator. 

(3)  by  comparing  (2.20)  and  (2.23)  and  observing  the  condition 
displayed  in  (2.24) ,  then 


(2.32) 


that  is,  £  is  uniformly  differentiable  on  D  with  respect  to  all  x  e  D. 

(4)  r_'  (x)  is  continuous  in  D_  iff  r_  has  a  locally  uniform 
differential  -  condition  (3)  exists  -  and  if  (x)  is  locally  bounded 
on  D^. 

Locally  bounded  means  every  5c  s  D_  has  a  neighborhood  N  (x ,  • )  in 
which  ||  r_'  (x)  ||  is  bounded,  Vainberg  [20]. 

Bounded  in  norm  is  an  immediate  consequence  of  continuity;  r_'  (jc)  is 
uniformly  continuous  iff  r_(x)  is  uniformly  differentiable. 

(5)  if  T'(x)  is  uniformly  continuous  in  an  open-bounded  convex 
domain  D,  then  the  F  differential  is  uniform  in  D^. 

Details  of  the  proofs  for  conditions  (4)  and  (5)  are  to  be  found 


in  [18] -[21]. 

By  observing  condition  (2)  proof  of  existence  of  the  F  differential 


is  a  prime  criterion.  A  proof  of  this  is  offered  in  section  2.3. 


'  t 


. 


23 


2 . 3  The  Existence  of  the  F  Derivative 

In  the  latter  part  of  section  2.2  reasons  for  utilizing  the  F 

/ 

derivative  were  stated.  One  condition  which  emerged  as  being  of 
paramount  importance  was  that  the  F  differential  must  exist. 

In  this  section  sufficient  conditions  for  the  proof  of  existence 
are  presented.  The  presentation  is  made  in  the  following  manner: 

(1)  if  the  F  derivative  exists,  then  proofs  are  presented  which 
will  show  that, 

(a)  the  partial  derivatives  must  exist  and  be  continuous, 

(b)  the  Lipschitz  condition  is  satisfied  for  a  multi- 
variable  system. 

(2)  if  the  partial  derivatives  exist  and  are  continuous,  then  the 
F  differential  exists;  sufficient  conditions  only. 

(3)  from  the  existence  of  the  F  differential  it  will  be  shown 
that  the  F  derivative  exists  and  is  a  linear  operator. 

(4)  an  argument  is  presented  which  substantiates  the  unique 

representation  of  the  F  derivative,  -  if  it  exists  and  is  a  linear 
operator  -  by  a  Jacobian  matrix.  , 

For  convenience  this  representation  will  be  used  early  in  the 
section,  but  will  not  be  justified  until  later. 

Figure  2  is  instructive  in  the  development  of  the  F  derivative 
from  the  G  differential. 

Suppose  that  the  F  differential  does  exist  at  a  point  x_  e  I)  in  the 
direction  h  e  X_.  Previously  it  was  stated,  equation  (2.15),  that  the  F 
differential  could  be  represented  by  £(x;  h)  where 


g  =  <gr  g2, - -  9n> 


(2.33) 
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and 

h  =  (h_  ,  h  , - ,  h  )  (2.34) 

—  12  n 

Proof  of  existence  of  the  partial  derivatives ,  based  on  the 
hypothesis  that  the  F  differential  exists  and  can  be  represented  as 
above,  will  now  be  presented. 


Proof : 

A  vector  u  is  defined  as  u  =  (u. ,  uo/  - ,  u  )  where  u..  ,  etc. 

—  —  12  n  12 

are  the  unit  vectors  which  form  the  basis  of  the  vector  space  c  Rn. 

A  component  of  the  vector  u  i.e.  u ,  is  defined  as 

u_.  =  (o,  o, - ,  o,  1,  o, - ,  o)  ;  a  1  in  the  jth  position.  Thus  h 

can  be  uniquely  written  as 

h  =  h-U.  +  h_u^,  + - +  h  u  (2.35) 

—  1  1  2  2  n  n 


n 


(2.36) 


then 


n 


g.  (x;  h)  =  g.  (x;  \  h  .u.) 
1  -  -  1  -  3  3 


(2.37) 


j=l 


Since  £(x^;  h_)  is  homogeneous  in  h  of  degree  one,  equation  (2.37)  can  be 


written 


n 


gi^— '^h.u.)  =  gi(x;  +  9^21'*  h2U2^  + 

j=l  3  3 


- + - +  g.  (x;  h  u  ) 

l  —  n  n 


(2.38) 


. 
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g.(x;  u  ) h  +  g.  (x;  u  )h  + 

i—  11  l  —  2  2 


-  +  -  +  g. (x;  u  ) h 

l  —  n  n 

(2.39) 

=  a .  x  (x)  hx  +  a.2(x)h2  +  — 

-  +  -  +  a.  (x)h 

in  —  n 

(2.40) 

n 

C - ) 

=  )_jaij(X)hj  / 

j=i 

(2.41) 

where 

aij(x)hj  =  gi(x;  u  )h  . 

(2.42) 

From  equation 

(2.24)  h  =  y.  ~  x  therefore. 

h.  =  y.  -  x.  V  j  =  1,  2, - ,  n. 

J  J  J 

(2.43) 

If  x  is  allowed  to  vary  in  one  direction  only,  at  a  time,  then 

Y_  =  x  +  Auj 

(2.44) 

where 

/ 

o  <  | A |  <  6  then 

°  <  \\z  -  2ili=  llx  II  • 

(2.45) 

Thus 

yj ' 

x .  =  A  =  h . 

J  J 

(2.46) 

and  -  x^  =  o  for  k  ^  j,  therefore  =  o. 

Substituting  h_.  and  h^  into  equation  (2.41) 


g^x;  ~  =  a±  j  (x)  X  / 


(2.47) 


r, 


since  all  the  other  terms  of  the  summation  are  zero,  by  virtue  of  the 
fact  that  sc  differs  from  y_  only  in  the  jth  co-ordinate.  If  equation 
(2.15)  is  now  substituted  into  (2.23)  and  only  the  ith  component  of  r_  is 
considered  then 


r.  (x  +  Xu.)  -  r.  (x)  -  g.  (x;  y  -  x)  |  |  <  e  ||h.  ||  .  (2.48) 

i—  — d  1—  1—  —  —  1  1  —  j 


Now  substitute  (2.47)  and  h.  =  X  into  (2.48). 

3 


Thus 


r . (x  +  Xu . )  -  r. (x)  , 

1  —  — d  1  —  -  a.  .  (x) 

- — -  ID  - 


<  e 


(2.49) 


and 


lim  r. (x  +  Xu.)  -  T. (x)  9 r. (x) 

,  1—  — ]  1  —  =  1  — 

X-*o  - r— -  - - - 


9x . 
3 


(2.50) 


Because  e  is  arbitrary  and  positive  this  implies 


ar. (x) 

a  (x)  =  -ri -  (2.51) 

lj  —  dX_. 

and  also  that  a..(x)  exists;  therefore, 

13  - 

ar. (x) 

a.  .  (x)  =  g.  (x;  u. )  =  — ^ -  .  (2.52) 

13  -  1  -  d 


Conclusion : 

(1)  g.  (jc;  u.)  can  be  uniquely  represented  by  a.  .  (x)  . 

r  D  3 

(2)  Because  of  the  continuity  condition  (equation  (2.49))  the 
partial  derivatives  exist. 

Therefore,  if  the  F  differential  exists  then  all  the  partial 


derivatives  must  exist. 
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Substitute  equation  (2.52)  into  (2.41)  and  write. 


gL (x ;  h) 


n 


L- 


j=l 


3T. (x) 

l  — 

3x . 

3 


h .  . 
1 


Replace  h.  by  equation  (2.43)  then 


(2.53) 


g^x;  h) 


n 


3r. (x) 

i  — 


x .)  . 

3 


Writing  equation  (2.48)  in  a  more  general  form  gives. 


(2.54) 


||  r\(x  +  h)  -  I\(x)  -  gi(x;  h )  1 1  <_  e  1 1  h  1 1 


(2.55) 


which  can  be  rewritten  as 


II  ri(2i  +  h)  -  ri(x)  ||  £  e  ||h||  +  ||  g^(x;  h )  1 1  . 


Taking  the  norm  of  (2.54) 


II 


<3±  (x? 


aiMx) 


3x . 
3 


(2.56) 


n 


< 


j=l 


ar. (x) 

Ik- ill 


3 


ar. (x) 

i  — 


(2.57) 


but  h  =  y  -  x  therefore. 


l|h||  =  Ik  -  ill  • 


(2.58) 
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Therefore  if  (2.57)  and  (2.58)  are  now  substituted  into  the  R.H.S  of 
(2.56)  then  it  may  be  rewritten  as 

||r.(x  +  h)  -  r  (x)||<  ||  y  -  x  || 

\  I 

It  was  stated  earlier  that  £'  (x)  <  00  (by  hypothesis)  therefore,  each 
component  must  also  be  bounded,  that  is 


e  + 


l  — 
3  V 


(2.59) 


f'i(x)  <  °°  V  i  =  1,  2, - ,  n 


(2.60) 


from  which  it  follows  that 


V  ii  3ri(- 

3x .  II  <“  .  (2.61) 

j-1  3 


Now  let 


then 


M. 

l 


n 


e  + 


ar. (x) 

1  — 


.  3x . 

j=l  D 


||  (x  +  h)  -  r±(x)  ||  £  nl  1 1  y  -  x 


(2.62) 


(2.63) 


thus  the  Lipschitz  condition  is  satisfied  on  a  component  basis,  because 
of  the  initial  hypothesis  that  the  F  differential  exists.  Proof  that 
the  results  stated  in  (2.63)  can  be  extended  to  include  all  i,  where 
i  z  1/  2,  - ,  n  and  be  written  as 


1 1 £(*  +  h )  “  £(x)  1 1  £  m| |  y  -  x 


(2.64) 
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where 

M  =  sup  {M. }  ,  (2.65) 

i 

will  now  be  presented.  The  proof  is  developed  via  the  one  dimensional 
intermediate  value  theorem,  and  utilizes  the  principle  of  convexity  in 
Banach  spaces. 

Proof ; 

Consider  a  sphere  D  c  X  of  radius  r  >  o ,  centred  at  some  point 

x^  e  D,  let  x,  y  e  D  and  let  Tj  DcX  -*  X.  A  line  segment  is  considered 

as  connecting  the  two  points  3C  and  y;  a  point  z_,  which  is  on  the  line 
segment,  is  defined  in  terms  of  x  and  y^  by 

z_  =  x_  +  \(y_  -  x)  ,  o  <_  X  <_  1.  (2.66) 

Keeping  X  fixed  and  introducing  a  new  function  which  depends  only 

upon  X,  i.e.  y^(X) ,  which  is  the  "distance"  between  the  images  of  x  and 

x  +  X  (y  -  x)  under  r_,  then 

y_(X)  =  r_(x  +  X  (y  -  x)  )  -  F_(jc)  .  (2.67) 

If  now  X  =  1,  then 

yd)  =  Hy)  -  £(x)  (2.68) 

and  if  X  =  o  then 

y (o)  =0  (null  vector), 


✓ 


(2.69) 


■ 
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therefore , 


Y(l)  -  Y(o)  =  r  (y)  -  f(x)  . 


(2.70) 


Consider  now  the  ith  component  of  y_,  that  is  y.  for  i  =  1,  2, - ,  n, 

partition  the  interval  [o,  1] ,  o  =  A  <  X,  <  -  <  X  =  1,  and  let  X 

o  1  n  g 

and  X  be  two  different  but  fixed  points  in  the  partition,  therefore, 

K 


y. (X  )  -  y . (X  ) 

i  g  i  k 


r.  (x  +  x  (y  -  x))  -  r.  (x) 

i  —  g  —  —  i  — 


-  r .  (X  +  X,  (y  -  x) )  +  r  •  (X) 

X  K  *"”*  X 


=  r.(x  +  X  (y  -  X))  -  r. (x  +  X(y  -  x) ) 
i  —  q  —  —  l  —  k  —  — 


(2.71) 


Now,  by  considering  each  component  of  jc  and  y  e.g.  x_.  ,  y  typically, 
equation  (2.71)  can  be  rewritten  as 


r.(x.  +  X  (y  -  x.))  -  r.(x.  +  Xk(y.  -  x.)) 


ar.  (•) 

-  (X  -  X.  )  (y.  -  x  )  , 

3x .  g  k  3  3 


(2.72) 


where 


ar.  (•)  ar. (x.  +  0(y.  -  x. )> 

3x .  3x . 

3  3 
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and 


X  < 
g 


6  <  X,  ; 

k 


ari  (- ) 


3x . 
3 


is  the  mean  slope  in  the  interval  (X  , 

g 


The  material 


which  was  developed  earlier  and  culminated  in  equation  (2.53)  is  now 
utilized,  that  is,  we  can  rewrite  (2.71)  as 


n 


3I\  (•) 

r 

Lj 


y.  (X  )  -  y  (X  )  -)  -ji -  (X  -  X  )  (y .  -  x.) 

ig  ik  z_j  3  x.  g  k^j  i 

j=l 


for  all  i  =  1,  2,  - ,  n. 


But 


dy. (•)  y. (X  )  -  y . (X  ) 

1  i  g  1  k 

__  = 


X  -  xn 
g  k 


(2.73) 


where 


( * ) 


dX 

g 


is  the  mean  slope  in  the  interval  (X  ,  X  ) . 

g  k 


Therefore , 


vy  -  w 

x  -  x, 
g  k 


3l\(-) 


3x . 
3 


(2.74) 


dy. (•) 

l 


dX 

g 


d£(* ) 
dX 


a  column  vector 


dTn(,) 

dX 


The  general  form  of  equation  (2.74)  is 


dy(» ) 
dX 


ar .  (•) 

i 


9x . 
3 

L 


(y  -  x) 


(2.75) 


where 


ar.  (•) 

l 

9x . 


is  the  Jacobian  matrix  of  r9(«)  [18],  and  is 


written 


T'  (•)  = 


3r1(*) 

9x, 


3rn(,) 

9x, 


3^(0 

9x^ 


3r1(o 

9x 


n 


3^(0 

9x 

n 


(2.76) 


9r  (•) 

Writing  — -  in  the  form  a.  .  (•)  ,  equation  (2.51),  then  (2.76)  can  be 

9x.  in 

3 

rewritten  as 
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The  elements  of  the  Jacobian  matrix  are  the  first  partial  derivatives 

of  the  vector  x,  with  respect  to  its  components.  They  were  obtained  via 

the  one  dimensional  intermediate  value  theorem. 

Now  extend  the  region  between  X  and  X  to  X  =1  and  X  =  o,  then 

g  kg  k 

equation  (2.74)  can  be  rewritten  as 


Yi(1)  "  Yi(o) 


l-o 


(2.78) 


where  X,  is  an  intermediate  value  of  X,  in  the  interval  [0,  1] .  But 
k  k 


y^(o)  =  o  (equation  (2.69))  therefore, 


Y±(l)  = 


(2.79) 


and  from  equation  (2.70) 


Y±(l)  -  y.(o)  =  I\(y)  -  T.(x)  . 


(2.80) 


By  virtue  of  (2.75)  we  can  write 


d  (•) 
Y 


=  r  (y)  -  r  (x) 


3x . 
3 


(y  -  x)  ; 


(2.81) 


' 


' 


'  ■ 


and  taking  the  norm  of  (2.81) 


ari(.) 


9x 


L  j  J 


9x . 
3 


(2.82) 


which  is  valid  for  all  x  and  y  in  the  neighborhood  of  x  [22] . 

—  —o 

A  comparison  of  (2.64)  and  (2.82)  reveals  that 


M 


n 


e  +  sup 
i 


3ri(x) 


(2.83) 


and  since  e  is  positive  and  arbitrary  the  equation  (2.82)  can  be 
rewritten  as 


(2.84) 


Conclusion : 

The  Lipschitz  condition  is  satisfied  for  multivariable  systems. 

The  concept  of  the  one  dimensional  intermediate  value  theorem  has 
been  used  to  extend  the  "local"  properties  of  the  F  derivative  to  the 
"global"  properties  of  the  quotient,  as  discussed  in  section  2.1. 

It  was  stated  earlier  in  this  section  that  sufficient  conditions 
only  exist  in  the  proof  of  the  F  differential.  These  conditions  will 


now  be  developed. 


' 


.  . 


. 


' 


■ 
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Proof : 

Suppose  that  the  partial  derivatives  do  exist  and  are  continuous  at 
a  point  x,  then  there  exists  an  e  >  o  such  that  if  y  e  N(x,  6/2)  then 
this  implies,  Luenberger  [31] 


3r. (x) 

l  — 


£ 

<  n  > 


(2.85) 


where  j  and  i  =  1,2, - ,  n.  Because  different  neighborhoods  exist  for 

each  component  of  x  let 


6 '  =  inf (6  ,  6  , - ,  6  )  . 

12  n 


Now  let  N, 
— k 


such  that 


N  =0  (null  vector) ,  and  further  N,  satisfies  the  following  recurrence 
o  — k 

relationship 


2k-i 


(2.86) 


therefore , 


But 


thus 


IINjJI  1  IlhJI  for  all  k. 


y  =  x_  +  hu 


r .  (y)  -  r .  (x)  =  r.(x  +  hu)  -  r .  (x) 
1  —  1  —  1  —  1 


(2.87) 


(2.88) 


f 


(2.89) 


. 


now  because  of  N, 

— k 


h  .u . 
-j  3 


we  can  write  (2.89)  as  follows 


n 

r.  (x  +  hu)  -  r .  (x)  =  V-1  r .  (x  +  n)  -  r .  (x  +  n  )  (2.90) 

1  /  ,  1  K  1  K"”l 

k=l 


and  by  substituting  (2.86)  into  (2.90)  the  general  term  of  (2.90)  may  be 
written  as 


ri<^  + V  -  ri(£  +  2k-i>  -  Vi+Sk-i  +  ikV  -  ri(^  +  ^-i>. 

(2.91) 


Which  is  the  difference  of  one  component  of  the  operator  £_  at  two  points 

th 

the  two  points  differ  only  in  the  k  co-ordinate  in  the  neighborhood 
N(x,  6'/2). 

A  new  function  is  introduced  at  this  point 


P(W  -  ri(i+\-i +  4V 

p (0)  =  r.  (x  +  n,  ,) 

—  l  —  — J<r  —  I 


(2.92) 

(2.93) 


and  the  intermediate  value  theorem  is  utilized  again  to  write 


p(hkuR)  -  P(0_) 

^  -i 


-  p’%> 


(2.94) 


where 


(2.95) 
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Then 


p(Jy\  +  x\>  -  p(Vk> 


Y 


Va +  4-i +  Vn +  xy  -  r<  <2i +  +  4\’ 

X 


(2.96) 


taking  (2.96)  to  the  limit,  y_  -*  6^  then 


lim 
y_  ->  0 


P(Vk +  *V  ~  p(iW 

Y 


3ri(^  +  "*-1  +  Vk> 


Now  rewrite  (2.94)  as  follows 


(2.97) 


p(hkuk)  -  P(0_)  =  h^P'(h^u^)  (2.98) 

and  substitute  equations  (2.92),  (2.93)  and  (2.97)  into  (2.98)  which 

results  in 


ri<^+  4-i +  4V  -  ri(^  +  Vi1 


=  h.  3ri(-  +  4-1  +  W 

— k  _ _ 

3x, 


(2.99) 
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Substitute  (2.99)  into  (2.90)  to  obtain 


n 


I\  (x  +  *iu) 


I\(x) 


.  3r.  (x  +  N,  +  h-  u.  ) 

/  j  h,  i  —  — k-1  He  k  u 

k=l  _  k 

3xk 


n 


Z  h  +  Vk>  3ri(^  +  \u 

3xk 


k=l  — k\ 


9x,  9x. 

k  k 


n 


n 


E  h!V^U  +  E  hk  (8ri(^ +  4-i +  ^uk  -  d_h 


(X) 


k=l  ^k 


9x, 


k=l 


\ 


9x. 


)Xk  '  (2.100) 


and  from  equation  (2.53)  it  is  seen  that 

n 


g. (x;  h) 

l  —  — 


E 


9r. (x) 


(2.101) 


The  remainder  of  the  terms  in  the  R.H.S.  of  equation  (2.100)  are  now 
considered,  that  is 


n 


E 

k=l 


h  u 

~ k  k 


3ri(^  *  *  hfcV 

3x. 


3F.(_x) 

3x, 


(2.102) 


■ 


' 


By  combining  (2.87)  and  (2.88)  it  is  seen  that 


II +  V^ll  i  lliill +  II  hull 

(2.103) 

i  2||h||  <  6’  . 

Therefore,  the  combined  effect  of  (2.85),  (2.88)  and  (2.103)  on  (2.102) 
will  cause  this  to  reduce  to  e (h) .  Thus  (2.100)  can  be  rewitten  as 

T. (x  +  hu)  -  T. (x)  =  g. (x;  h)  +  £ (h)  (2.104) 

i—  —  i—  l  —  —  — 

but  since  x  +  hu  =  y_  then  (2.104)  may  be  rewritten  as 

T.(y)  =  T.(x)  =  g. (x;  h)  +  e (h)  .  (2.105) 

l'*-  l  —  l  —  —  — 


Therefore, 


||r.(z)  -  I\(x)  -  g±(x;  h)  ||  1  e||  -  x|l 


(2.106) 


and  since  y  is  arbitrary  in  N  (x ,  S'/2)  the  differential  g^x;  h) 


exists . 


' 


. 


Conclusion : 


If  the  partial  derivatives  exist  and  are  continuous  then  the  F 
differential  exists;  sufficient  conditions  only. 

Now  that  sufficient  conditions  have  been  established  to  prove  the 
existence  of  the  F  differential  it  only  remains  to  show  that  the  F 
derivative  exists. 

In  previous  sections  it  was  stated  that  the  F  differential  was 
homogeneous  in  h  of  degree  one.  The  proof  was  not  presented  at  that 
time,  this  will  now  be  corrected.  Also  proof  that  the  F  differential 

is  linear  will  be  offered.  Sections  of  this  proof  are  to  be  found  in 

Vainberg  [20], 

Proof : 

■  .  ■  —  ■  \ 

Suppose  that  T :  D  c  X  -*•  Y  has  at  a  point  x  £  D  an  F  differential 

then  there  exists  an  e  >  o  such  that  if  y  e  N  (  jc  ,  6)  this  implies  that 

the  F  differential  is  linear. 

r(x  +  h)  -  £(x)  =  g (x;  h)  +  o 

r_(x  +  m )  -  r_(x)  =  £(x;  rn)  +  a_2 

and 

£(x  +  m  +  h )  -  r_(x)  =  g(x;  m  +  h )  +  £3 

where 

II  “ill  <  f  i  -  2'  3'  4- 

Combine  equations  (2.107) ,  (2.108)  and  (2.109)  and  take  the  norm  of 


(2.107) 

(2.108) 

(2.109) 


both  sides,  then 


v 


|| £(x  +  m  +  h )  -  £(x  +  m)  -  £(x  +  h)  -  £(x)  ||  +  ^ 


(2.110) 


but 


f  (x  +  m  +  h)  -  T  (x  +  m)  =  g(x  +  m;  h) 


+  —4 . 


(2.111) 


Now  substitute  equations  (2. 107) and  (2.111)  into  (2.110)  and  write 


I  E  +  h)  -  £ (x;  m)  -  g(x;  h)  ||  < 

||g(x  +  m;  h)  -  g(x;  h)  ||  +  ~  . 


(2.112) 


By  generalizing  equation  (2.55)  it  is  seen  that  £(x;  •)  exists  and  is 
continuous,  therefore,  by  suitable  choice  of  6 


||  g(x  +  m;  h)  -  g(x;  h) 


<  £ 
4 


(2.113) 


and  if  (2.113)  is  substituted  into  (2.112)  then 


|  g_(x;  m  +  h )  -  g(x;  m)  -  g(x;  h)  ||  £  e  . 


(2.114) 


Since  e  is  arbitrary  and  positive  then 


£(x;  m  +  h )  =  g (x;  m)  +  g_(x;  h)  , 


(2.115) 


■ 


Conclusion: 


The  additivity  property  of  g_( ; )  is  satisfied.  It  will  be 

i 

remembered  that  the  homogeneity  condition  was  satisfied  in  equation 
(2.17).  Therefore,  it  can  be  concluded  that  the  F  differential  is 
linear  in  the  variable  h,  and  thus  exists. 

It  can  be  seen  from  equation  (2.52)  that  £(3c;  h)  -  £/  (x)h.  The 
operator  which  assigns  r_'  (x)  to  x  is  called  the  F  derivative  of  r_.  The 
derivative  has  its  domain  in  the  same  space  as  the  original  operator, 
also  it  has  the  same  range  space  as  the  original  operator. 

Matrices  are  closely  related  to  linear  transformations;  this  fact 
is  well  known.  Consider  the  following  system  of  "n"  linear  equations 


allhl  +  a!2h2  +  -  - 


-  -  +  a  h  =  Z 

In  n  1 


a„, h  +  a„„h„  + 

21  1  22  2 


-  -  +  a.  h  =  Z 

2n  n  2 


I  I 


(2.116) 


a  h  +  --  --  -  +  a  h  =  Z 

nl  1  nn  n  n 

it  is  equally  well  known  that  this  set  of  "n"  linear  equations 

assigns  a  unique  set  of  "n"  variables  Z^,  -  -  -  ,  to  every 

set  of  h  ,  h  ,  -  -  -  ,  h  variables.  This  assignment  is  called  a 
12  n 

.  2 

linear  transformation  and  is  characterized  by  an  array  of  n 
coefficients,  which  is  a  matrix.  If  the  general  row  of  (2.116)  is 
compared  to  the  general  row  from  (2.53)  it  will  be  seen  that  they 
have  the  same  form,  providing  (2.53)  represents  a  linear  equation.  The 
proof,  equations  (2.107)  to  (2.115)  ,  has  shown  r_'  (x)  to  be  a  linear 


' 
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operator.  Its  components  can  be  shown  to  be  the  same.  Thus,  the 
comparison  reveals  equivalency.  The  justification  for  writing  T ' (x)  as 
a  Jacobian  matrix  was  not  revealed  at  the  time  that  (2.76)  was 
presented.  In  the  light  of  the  proof  mentioned,  i.e.  the  last  proof  in 
this  section,  and  the  material  which  followed,  the  representation  is 
justified. 

Conclusion : 

If  TJ  (x)  exists  and  is  a  linear  operator  it  may  be  uniquely 
represented  by  a  Jacobian  matrix,  Nashed  [18]. 

2 . 4  The  Banach  Contraction  Mapping-Fixed  Point  Principle 

It  was  stated  earlier  in  this  chapter  that  the  Banach  contraction 
mapping- fixed  point  principle  would  be  used  as  a  means  of  obtaining  a 
solution  to  the  non-linear  mapping  problem.  For  brevity  it  will  be 
called  the  "fixed  point  principle". 

A  statement  exists  which  asserts  that  under  certain  conditions  an 
operator  from  a  domain  of  a  Banach  space  into  itself  admits  a  fixed 
point,  that  is 


r(x*)  =  x* 

this  means  that  a  method  of  successive  substitution  yields  a  sequence 
converging  to  a  solution  in  the  space. 

This  section  will  present  the  fixed  point  principle  and  some  of 
its  ramifications.  A  formal  proof,  not  presented  here,  is  available  in 
the  literature  [23]— [25] . 


. 
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Let  £  be  a  non-linear  operator  whose  domain  and  range  lie  in  the 

same  space.  The  contraction  condition  is  stated  as:  an  operator  T 

is  defined  in  N(xq*/  a)  and  suppose  there  is  a  number  K  such  that  for 

every  pair  of  points  x  * ,  x  *  £  N(x*  ,  a)  then 

—1  2  —  o 

lll^2*)  ~  L<2L1*HI  1  Kll  2L2*  -  21-l*  II  (2.117) 

where  o  <_  K  <  1 

The  fixed  point  condition  is  written  as 

||  T(x  *)  -  x  *||  <  (1  -  K) U  .  (2.118) 

If  the  conditions  of  (2.117)  and  (2.118)  are  both  satisfied  then  a 
unique  fixed  point 


x*  e  N(x  *,  a) 
—  —o 


(2.119) 


will  exist. 


A  sequence  can  be  generated  via  the  non-linear  operator  £_(*)# 


that  is 


!(*!*) 

ru2*) 

l 


=  X 


-2 


=  x 


-3 

1 


I  I 

I  I 


(2.120) 


r(x„*) 

l 


=  V  " 

— '  — n  +  1 


=  x* 


r(x*) 


i  t  ■  > 


* 


which  it  is  seen  terminates  in  a  fixed  point 

£(x*)  =  x* 

The  subscripts  which  are  attached  to  jc*  indicate  the  approximation  to 
the  final  solution. 

Then 

x*  =  lim  x*  =  lim  Tn(x  *) 

—  —  n  —  -o 

n  oo  n  -*  00  , 


By  virtue  of  (2.3(d))  it  is  seen  that  (2.117)  and  (2.118)  demand  that 

T(#)  be  continuous  in  N(x  *,  a),  and  because  it  has  a  derivative  of 
—  — o 

every  point,  in  the  neighborhood  it  is  continuous.  Thus  (2.117)  implies 
that  the  supremum  of  the  sum  of  the  incremental  slopes  will  not  exceed 
K  anywhere  in  the  neighborhood.  Which  in  turn  implies  a  local  concept. 

A  method  which  pieces  together  the  "local"  solutions  into  a 
"global"  solution  and  extends  the  region  has  been  presented  by  Chu  and 
Diaz,  [14].  Trott  and  Christensen  [11]  have  utilized  the  method  in 


their  research. 


' 


CHAPTER  III 


CONTINUOUS  CONTROL  SYSTEMS  AND  THE  VOLTERRA  SERIES 

3 . 0  Introduction 

This  chapter  draws  upon  the  material  derived  and  presented  in 
Chapter  II.  Evaluating  the  contraction  mapping  and  fixed  point 
conditions  are  detailed  in  sections  3.1  and  3.2  respectively.  Details 
of  the  Volterra  series,  its  generation  etc.,  are  to  be  found  in 
section  3.3. 

Concluding  this  chapter  is  section  3.4,  which  contains  a 
demonstration  of  the  method  which  is  developed  in  the  thesis,  where  a 
differential  equation  representative  of  a  practical  non-linear  system 
is  solved.  Previously  the  equation  has  been  solved  by  Christensen  [27] 
and  Barrett  [9],  but  by  a  different  method. 


3 . 1  Determination  of  the  Contraction  Condition 

Consider  the  following  matrix  vector  differential  equation,  which 
is  typical  of  non-linear  systems, 

x(t)  =  Ax(t)  +  af_(x(t)  )  +  By (t)  .  (3.1) 

The  system  considered  is  time  invariant  where 


A 

"n  x  n"  constant  matrix 

x(t)  = 

"n"  vector 

y  (t)  = 

"n"  vector 

B 

"n  x  n"  constant  matrix 

a  = 

"n  x  n"  constant  matrix 

f(x(t)) 

=  "n"  time  invariant  vector 

and  f(x(t))  e  C([a,  b] ,  [£]  ,  R  ). 
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The  solution  of  (3.1)  is  well  known  to  be  [30] 

x*(t)  =  $_(t)x^  +  /t$_(  t,s)By(s)ds  +  /t$_(tfs)  a,  £(x*  (s)  )  ds .  (3.2) 

where  M*)is  the  state  transition  matrix. 

Similarly  the  solution  of 

x(t)  =  Ax (t)  +  By ( t) ,  (3.3) 

which  is  a  time  invariant  linear  matrix  vector  differential  equation, 
is  known  to  be,  Ogata  [30], 

x(t)  =  $(t)x  +  /t<J>(t,s)  By  (s)  ds .  (3.4) 

—  —  —o  o  —  — 

If  a  =  9_  (the  null  matrix)  then  (3.2)  takes  the  same  form  as  (3.3) 

therefore,  x  =  x  . 

— o  —o 

The  solution  of  (3.2)  can  be  obtained  by  iteration  techniques, 
which  requires  that  a  convergent  sequence  be  developed.  Let  us  then 
rewrite  (3.2)  and  (3.4),  respectively,  in  a  simplified  form,  that  is, 
let 

x*=g_+^+u*  (3.5) 

x  =  SL  +  —  (3.6) 

and  substitute  (3.6)  into  (3.5)  which  results  in 

x *  =  x  +  u *  ,  (3.7) 

which  is  a  linear  system  plus  a  perturbation,  where 
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(3.8) 

(3.9) 

(3.10) 

If  (3.10)  is  now  substituted  into  (3.7)  then 


g  =  $  (t)  x 
—  —  — o 

=  /t$_( t,s)  By  (s)  ds 
u*  =  /S(t,s)  a_  _f(x*  (s)  ) ds . 


x*(t)  =  x(t)  +  /t$_(  t,s)  £(x*  (s)  )  ds.  (3.11) 

The  sequence  required  in  the  sequel,  and  referred  to  above,  will  now  be 
developed  from  (3.10)  that  is 


X* 

=  X 

+ 

u 

—  1 

—  o 

=  X 

+ 

U1 

—  2 

— “ 

—1 

(3.12) 

X*  =  X  +  u 
—  n  —  — n-1 

I  I 

I  I 

I  I 

X  *  =  X  +  u  * 

Where  the  subscript  attached  to  x*  indicates  the  degree  of  approximation 
to  the  final  result,  that  is  x*^  is  the  first  approximation  to  x*. 

Now  substitute  (3.7)  into  (3.10)  thus 

u*(t)  =  /%( t,s)  a_  £(x(s)  +  u*(s))ds  (3.13) 


from  which  it  follows  that 


■ 


and  if  we  let  u  (t)  =0  (the  null  vector)  then  (3.14)  becomes 

—o  — 


u^(t)  =  /  $_(t,s)  a_  :f  (x (s)  ) ds , 


(3.15) 


where  u^(t)  is  the  first  approximation  to  the  final  solution  u*(t). 
The  second  approximation  is 


u2(t)  =  /  $^(t,s)  a_  f (x(s)  +  u  (s))ds. 


(3.16) 


Similarly  with  the  third  approximation,  and  so  on  up  to  the  n 


th 


approximation  which  is  written  as 


u  (t)  =  /  $(t,s)  a  f(x(s)  +  u  (s))ds  . 
— n  o  —  -  — n-1 


(3.17) 


If  the  appropriate  element  of  (3.12)  is  now  substituted  into  (3.17) 


then 


u  (t)  =  f  $(t,s)  a  f(x*  (s))ds 
— n  o  —  - n 


(3.18) 


It  can  now  be  seen,  form  (3.17),  that  u  (t)  is  a  transformation 

— n 

involving  u  , (t) ,  g(t)  and  £(t).  Thus 
— n-1  —  — 


;  ■  ' 


* 


*  • 


■ 


therefore  the  general  term  of  (3.12)  can  be  written  as 


x*  =  x  +  u 
—  n  —  — n-1 


=  x  +  r-i  9  *) 

=  r(x,  u  ) 

- — n-2 


a  r  (x*  .) 

- - n-l 


(3.20) 


A  new  operator  r_  has  now  been  defined  involving  the  approximations  to 
the  final  solution  and  the  iteration  leading  to  the  solution  can  be 
written  as 

x*  =  r(x  *) 

—  1 - 0 

x*2  =  r(xx*) 

I  I 

I  |  (3.21) 

x*  =  r(x*  ) 

—  n - n-l 

I  I  I 

I  I  I 

I  I  I 

x*  =  T(x*) 

From  the  ensuing  argument  it  is  clearly  seen  that  (3.2)  is  equivalent 
to  the  fixed  point  problem f 


x*  =  r (x*)  , 


(3.22) 


and  if  (3.5)  satisfies  the  contraction  condition  then  (3.19)  satisfies 


.  ■ :  -  . i 


' 
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||r(x*2)  -  r(x*1)||  <  k||  x*2  -  x*1||  , 


where  x*^  and  x*2  are  arbitrary  and  o  <_  K  <  1 
From  (3.20)  it  is  seen  that 


x*3  -  x*2  =  r(x*2)  -  r<x*  >  =  u2  -  U 


Substitute  (3.18)  into  (3.24)  and  write 


x*  -  x*  =  /  $(t,s)  a  (f(x*  (s))  -  f(x*  (s))ds. 
—  3  —  2  o—  — - 2  - 1 


But  from  (2.81) 


3f  . 

f(x*,(s))  -  f(x*  (s) )  =  [r-J-Hx*.  -  x* )  . 

- 2  - 1  ox  —  2  —  1 

k 


Substituting  suitable  elements  from  (3.12)  into  (3.26)  then 


3f.  ,  _  . 

f(x*  (s))  -  f(x*1(s))  =  -1  V 

k 


and  if  we  now  substitute  (3.27)  into  (3.25)  then 


nx*2)  -  r(x*1) 


af . 

f  $(t,s)  a  [-r— = -]  (u  -  u  )ds 
o  —  —  9x,  —1  —o 

k 


and  by  considering  only  the  R.H.S.,  (3.28)  may  be  written  as 


3f 


/ ( t  /  s )  a  [-r-i]  (u.  -  u  )  ds 


o  — '  '  —  9x.  —1  —o' 

k 


<  ft 

$ (t ,s) 

—  0 

ds 


sup 

t 


3f. 


u  -  u  M  . 
— 1  —o  11 


(3.23) 


(3.24) 


(3.25) 


(3.26) 


(3.27) 


(3.28) 


(3.29) 


V 


' 


52 


To  make  that  which  is  to  follow,  notationally  simple  it  will  be 
necessary  to  make  certain  substitutions.  Initially  let 


P(t)  =  / 

—  o 


$ (t ,s) 


ds  , 


where  P(*)  is  an  "n  x  n"  matrix  and 


(3.30) 


/t|  I ds  >  o  V  t>o 
o  1  1 


(3.31) 


by  hypothesis. 

Then  by  definition 


(t) 


hk(t>s) 


ds 


(3.32) 


therefore , 


P..(t_)  =  /  1 
lk  1  o 


ds 


(3.33) 


and 


P..(t_)  =  /  2 
lk  2  o 


ds 


(3.34) 


and  if  t^  >  then 


p.jtj  =  r  i 

lk  2  o 


ds  +  /, 


ds  . 


(3.35) 


Now  substitute  (3.33)  and  (3.34)  into  (3.35)  and  write 


Pik(t2>  =  Pik(tl)  +  ft. 


ds 


(3.36) 
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The  original  hypothesis  (3.31)  means  that 


/ 


ds  >  o 


providing  t^  >  t  , 

thus  (3.36)  can  be  rewritten  as 


P.,(t_)  >  P..(t_) 
lk  2  —  lk  1 


and  by  induction 


(3.37) 


(3.38) 


P.,  (t  )  >  P  (t  )  (t  >  t  ) 
lk  n  —  lk  n-1  n  n-1 


Therefore,  it  can  be  concluded  that 


(3.39) 


P.,  (t)  =  P.,  >  P.,  (t)  Vt<«  (3.40) 

lk  lk  —  lk 

t=°° 

where  P  is  the  supremum  of  the  terms  which  satisfy  (3.40) . 

The  P_  matrix  is  therefore  dominated  by  a  matrix  of  real  numbers, 
each  of  which  is  independent  of  t.  Thus 


pll(t) 

P12(t) 

< 

P11 

P12 

_P2X(t) 

P22(t^ 

P21 

P22 

nci 

for  a  2  order  system,  and  (3.30)  can  be  written  as 


P 


$ (t,s) 


ds 


(3.41) 


(3.42) 


where 


(3.43) 


■ 


■ 


and  t  is  the  time  interval  under  consideration  that  is ,  o  <  t  <  00 
is  the  time  elapsed,  therefore  o  <  s  <  t. 

Return  again  to  (3.29)  and  let 


z  (t) 


sup 

t 


■] 


where  z^*)  is  a  "n  x  n"  matrix,  and  a  component  of  this  matrix  is 
written  as 


z,  (t) 
Tern 


sup 

t 


a 


3fj 


kj  3x_ 


where  1  <  m  <  j 


Then  (3.29)  can  be  rewritten  as 


3f. 


f  $  (t,s)  a  [-r“-4  (u 

0  —  —  dX,  — 1 

k 


n 


u  )ds 
— o 


sup 


< 

—  i 


Pik  zkm(t) 


I  til  -  HoJI 


k=l 


and  by  the  original  definition  of  the  norm  (see  equations  2.6  and 


n 


k=l 


-  ||  P  z(t)  ||  . 


Hence  by  substituting  (3.42)  into  (3.41)  it  is  found  that 


3f  . 

/S(t ,s)  a  [- — ^*]  (u  -  u  )ds 

0  —  —  dX,  —1  — 0 

k 


<  P  z(t) 


and  s 


(3.44) 


(3.45) 


(3.46) 


2.7) 


(3.47) 


(3.48) 


now  substitute  (3.48)  into  (3.28)  to  obtain 


- 


> 


. 


■ 


Substituting  elements  of  (3.12)  into  (3.49)  causes 


(3.50) 


therefore  (3.49)  can  be  rewritten  as 


r(x2*)  -  r_(x1*) 


<  P  z(t) 


—2 


★  - 


V  1 
-1 


(3.51) 


Taking  the  supremum  of  (3.51)  over  t  results  in 


sup 

t 


2*) 


r^*) 


lStP  III  *(t)  II  II 


(3.52) 


and  since 


sup 


(3.53) 


then  clearly  (3.52)  can  be  written  as 


sup 

t 


I  Z. 


(3.54) 


which  is  of  the  same  form  as  (3.23)  if 


SUP  ||  P_  z_(t)  1 1  =  K  <  1 ; 


(3.55) 


which  satisfies  the  contraction  condition. 

A  natural  question  to  raise  at  this  point  is,  how  does  the 


F  derivative  fit  into  the  picture? 


The  connection  between  the  F 


' 


derivative  and  the  contraction  condition  will  now  be  shown. 

Let  3£2  e  S.  c  2L  '  w^ere  S  is  a  subspace  of  the  Banach  space  X_ 
and  x^,  x^  are  arbitrary  in  £,  also  let  £:  S  C  X  ■>  X  .  The  references 
for  this  section  are  [18],  [19]  and  [26]  who  have  utilized  the  mapping 
function  G  as  follows , 


0_U2>  -  G(il,  II  < 


G  (x  +  y(x2  -  xx)) 


—2 


(3.56) 


Let  us  now  apply  this  inequality  to  the  mapping 


G_  w  =  £  w  -  £'  ( x)  w 

where  x  is  fixed  in  S_  and  we£. 

Differentiating  (3.57)  with  respect  to  w  gives 

G'  (w)  =  £(w)  -  £'  (x) 


(3.57) 


(3.58) 


now  replace  w  in  (3.57)  by  x  and  then  by  and  subtract  one  equation 
from  the  other,  which  results  in 


G(x  )  -  G(x1)  =  £(x2)  -  £(x1)  -  £'  (x)  (x2  -  x±) 


(3.59) 


and  taking  the  norm  of  (3.59)  gives 


. 


Now  replace  w  in  (3.58)  by  (x^  +  y  (x^  -  x^)  )  and  take  the  norm  of  the 
result 


||  G’  0^  +  y(x2  -  j^)  ||  =  ||  £■  (Xl  +  y(x2  -  3^))  -  r  (x)  ||  ,  (3.61) 


and  substitute  (3.60)  and  (3.61)  into  (3.56) 


||rtx2)  -  r<Xl)  -  r-  <x)  <x2  -  *±)  ||  <  ^Jl  r- (xx  +  y(x2  -  ^1)  - 

I-(x)||  ||  x2  -  xjl  (3.62) 


which  can  also  be  written  as 


||r(x.) 


-  !<*!  > 


<  sup 
—  o<y<l 


Hr 


+ 


Y(x2 


(3.63) 


Reference  [18]  page  660 ,  has  shown  that 


SUp  ||  T  '  (x  +  y(x  -  x 
o<Y<l  —  — 1  —2  — 1 


<  sup 
—  x  e  s 


Hr  <£>ll 


(3.64) 


and  if 


sup 
x  e  s 


III' 


K  <  1 


(3.65) 


then  (3.63)  can  be  written  as 


' 


■  .  I  -,)!-  ,  i I 


<  '  :  nV\ 


(3.66) 


||r<x2)  -  ||  <  r-  (il  +  Y(x2  -  xx))  ||  ||  x2  -  xx 

<^|llf,(5?ll  11—2  "  —ill 
i  K  11—2  '  -lH  ■ 

Thus  an  upper  bound  is  provided  for  “  r_(x  *)  in  terms  of  r_' . 

Therefore,  it  can  be  concluded  that  if  the  norm  of  the  F  derivative  of 
the  operator  £_  is  less  than  one,  then  the  contraction  condition  is 
satisfied. 

It  has  been  shown  in  (3.66)  that  the  contraction  condition  is 
satisfied  if  the  norm  of  the  F  derivative  is  less  than  one.  But  how  is 
this  norm  to  be  evaluated  in  practice?  It  will  now  be  shown  that  an 
equality  does  exist  between  (3.55)  and  (3.65),  to  some  degree,  and  that 
it  is  possible  to  obtain  a  practical  estimate  of  the  norm  of  the  F 
derivative  by  determining  the  norm  of 


WjL  £(t)  II 


(3.67) 


and  limiting  its  magnitude  to  be  less  than  one. 

The  space  being  utilized  here  is  the  function  space  C  ( [a,b]  ,S^,Rn)  , 
which  was  described  in  section  2.1  and  specifies  the  domain  of 
operation.  Equation  (3.2)  is  rewritten  for  convenience 

x*  (t)  =  £(t)x^  +  /*"$>_( t,s)  13  y(s)ds  +  /%(t,s)  a_  £  (x*(s))ds,  (3.68) 


which  is  equivalent  to  the  fixed  point  problem 


_ 


I 
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x*  =  £(x*)  (3.69) 

on  C([a,b],  SO  .  Thus  £_(  • )  is  a  mapping  where 

Hx*)  =  $_(t)  x^  +  /%( t,s)  B  y(s)ds  +  /fc£( t,s)  <2  f_ (x*  (s)  )  ds  (3.70) 
as  previously  stated. 

To  determine  the  F  derivative  of  £.  it  is  necessary  to  utilize  Lemma 
8.5  of  Falb  and  DeJong  [15],  which  is  restated  here  for  convenience. 

n  n 

(i)  Let  S_  be  an  open  domain  in  R  ,  and  T  be  an  open  set  in  R  ,  which 
contains  [a,b] .  Suppose  that  T(t,x,s)  is  a  map  of  T  x  S ^  T  into  Rn  and 
is  measurable  in  s  for  each  fixed  J£(*)  an^  t,  and  is  continuous  in  x(«) 
for  each  fixed  s  and  t. 

Where : 

t  is  the  time  interval  under  consideration, 
s  is  the  time  elapsed  and  o  <_  s  <_  t. 

What  is  implied  by  T_(«)  being  measurable  in  s  for  each  fixed  t? 

If  jc(#)  is  a  type  of  continuous  function  then  t  is  the  time  over  which 
the  function  is  being  considered,  the  time  of  duration.  If  the  elapsed 
time  and  final  time  are  fixed  then  x(*)  is  continuous  by  hypothesis. 

(ii)  d—  (  ^  a  map  of  T  x  S_  x  T  into  L(Rn,  Rn)  (for  details  of  this 

9x 

space  see  [15],  [16]  and  [18]  and  definition  19).  The  partial 
derivative  is  measurable  in  s  for  each  fixed  x(*)  and  t,  and  continuous 
in  x(»)  for  each  fixed  s  and  t. 


* 


(iii)  There  is  an  integrable  function  m(t,s)  of  s  with 


sup 

t 


f 

a 


m  (t ,  s)  ds 


<  a> 


(3.71) 


such  that  ||  T(t,x,s)  ||  £  m(t,s)  and  ||  —  '-'S  ||<  m(t,s)  on  T  x  £  x  T. 

(3.72) 


(iv)  Z^'*'3)  "  T(f,x,s)||  ds  =  o 


(3.73) 


and 


lim  .bn  3T (t ,3c (s)  , s) 

t-»-t '  a  "  - 

ax 


3T(t ' ,x(s) ,s) 

ax 


o 


(3.74) 


for  all  t,  t'  in  [a,b]  and  x(»)  in  C([afb],S).  Thus  the  mapping  T  given 

by 


r(u(t) ) 


=  A(t, 

a 


u(s)  ,  s)ds 


(3.75) 


is  a  differentiable  mapping  of  C([a,b],  S)  into  C([a,b],  Rn)  with  the 
derivative  of  the  mapping  being  given  by 


(£'u  V)  (t)  =  / 


b  aT(t,  u(s) ,  s) 


V(s) ds 


au 


(3.76) 


where  u(*)  e  C([a,b],  S)  • 

The  proof,  which  is  contained  in  [15]  is  not  reproduced  here,  but 


the  argument  presented  by  the  authors  proceeds  as  follows 

(i)  observes  that  V  and  T '  are  actually  mapping  functions. 


I 


. 


. 
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(ii)  establishes  the  lemma  by  utilizing  these  mapping  functions, 
the  mean  value  theorem  and  the  Lebesque  dominated-convergence  theorem. 

Equations  (2.20) ,  (2.21)  and  (2.22)  of  the  thesis  are  similar  to 
those  used  and  proved  by  Falb  and  DeJong  in  the  establishment  of  this 
lemma. 

Therefore,  if 


(3.77) 


T ( t ,  x(s) ,  s)  =  $(t,s)  a  f (x ( s ) ) 


and  the  limits  of  the  integration  are  set,  that  is  a  =  o  and  b  =  t  then 


(3.78) 


where 


is  a  Jacobian  matrix 


and  T'(x(t))  is  the  Frechet  derivative. 


The  norm  of  the  F  derivative  can  be  written  as 


(3.79) 


II  ill  £1 


sup 


sup 

i 


(3.80) 


This  is  often  difficult  to  evaluate.  Therefore,  a  coarser 


estimate  of  the  norm  is  taken  in  practice,  and  that  is 


■ 
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n 


ds 


n 

sup\  ' 


a 


9f  . 

_ 1 

kj  9x . 


II  *11) 


(3.81) 


k=l 


j=l 


which  can  be  called 


II 


r*  (x) 


(3.82) 


where  the  subscript  "C"  means  coarse  to  some  degree.  The  above  is  for 
the  continuous  system. 

It  is  well  known  that  the  derivative  is  a  result  of  a  limiting 
process.  It  is  easily  shown  from 


-(-2*}  "  -(-l*}  -  £' (x1*)  +  £'  (xx*) 


x  *  -  X  * 


nx2*)  - 


ro^*) 


(3.83) 


that , 


T(x2*)  -  £(xx*)  .I  <  ,,r(x2*)  -  £(xx*) 


V  *  -  V  * 

-2  -1 


Y  *  -  Y  * 

-2  -1 


- 1'  >  II +  Hr  (*!>!!  (3-84) 


In  the  definition  of  the  F  derivative.  Chapter  2,  it  was  shown  that 


— (— 2*}  -(-l*}  -  £'  (xx*)  ||=o. 


(3.85) 


-2*  "  -1* 


in  the  limit.  Thus, 


, 


. 
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lim 


r(x2*)  -  nxx*) 

r'  (x/) 

s 

X  *  -  X  * 

— i 

-2 


-1 


(3.86) 


and 


sup 

x  *,  x2*  e  s 


r(x2*)  - 


r^x*) 


<  sup 
—  x*  e  S 


r' (x*) 


(3.87) 


alternatively 


sup 

o<y<1 

— i*  ’ 


-2 


e  S 


TJ  (xx*  +  y(x2* 


xx*)) 


<  sup  1 
—  x*e£  I 


r* (x*) 


(3.88) 


It  is  clearly  seen  that  the  L.H.S.  of  the  inequalities  (3.87)  and 
(3.88)  are  estimates  of  the  norm  of  the  actual  derivative.  The 
magnitude  of  the  norm  of  the  F  derivative  is  required  to  prove  that  a 
contraction  condition  does  exist.  This  was  the  conclusion  that  was 
reached  following  (3.66) .  The  practical  determination  of  the  fact,  that 
a  contraction  condition  does  actually  exist,  is  vital  if  a  Volterra 
series  solution  is  to  be  found  for  the  problem.  Details  of  the 
Volterra  series  are  to  be  found  in  section  3.3.  Thus  a  practical 
method  of  evaluating  the  norm  of  the  F  derivative  is  required,  this  can 
be  achieved  as  follows.  It  can  be  shown  from  (3.87)  and  (3.82)  that 


I(2L2*>  "  !(*!*) 

<  sup 
—  x*eS 

r* (x*) 

V  *  —  X  * 

-2  -1 

<  sup 

r • (x*) 

*: 


, 
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and  in  (3.54)  it  was  shown  that 


r* u2*)  -  n^*) 

<  sup 

p  Z(t) 

X  *  -  X  * 

L. 

(3.90) 


Therefore,  if  the  arguments  which  terminated  in  (3.54)  and  (3.81)  are 
compared  it  is  clearly  seen  that  (3.55)  can  be  equated  to  (3.82),  that 
is, 


£'  (x*) 

_  sup 

■J- 

P_  Z(t) 

L 

c 

=  K  <  1 


sup 

i 


sup 

t 


n 


i _ i 

k=l 


K  <  1  . 


(3.91) 


It  is  conceded  that  this  is  a  coarse  estimate  of  the  norm  of  the  F 
derivative,  but  it  is  easily  evaluated  for  practical  systems.  Therefore, 
it  can  be  concluded  that  if  the  magnitude  of  the  coarse  norm  is  limited 
to  be  smaller  than  one  then  the  L.H.S.  of  (3.89)  is  also  less  than  one. 
The  magnitude  of  the  norm  is  controlled  by  limiting  the  size  of  S_,  more 
details  of  this  are  to  be  found  in  section  3.3. 

3 . 2  Determination  of  the  Fixed  Point  Condition 

From  (3.19)  and  (2.118)  the  fixed  point  condition  is  written  as 


|  T.  (u  ,  £,  l)  -  u  ||  <  (1  -  K)  U 
1 1  — — o  ~  —  — o 


(3.92) 


i 


.....  5L  2  .1  |  -2  5 


which  can  be  rewritten  as 


-  Uq  II  <  (1  -  K)  U, 


and  by  the  definition  of  norm 


iii  -  Ho  II  "  S"P  -  ^(t)  ||  <  (1  -  K)«. 


If  u  (t) 
—o 


=  0  and  (3.14)  is  substituted  into  (3.94)  then 


sup 

t 


/  <£(t,s)  cx  f_ (x*  (s) )  ds 


<  (1  -  K)U 


from  which  it  follows  that 


/  £(t,s)  a  f(x*(s))ds 


£/t|£(t/s)||  a£(x*(s)) 


ds 


<  /t|$(t,s) Ids  s“p 
—  o  1  —  1  t 


a  f  (x*  (t) ) 


now  utilizing  (3.43)  again,  that  is  let 


P.,  =  /fc  "|t.  <t,s) 
lk  o  1  lk 


ds 


and 


sup 
L  =  * 

k  t 


a.  .f  .  (x*  (t) ) 
k]  ]  - 


(3.93) 


(3.94) 


(3.95) 


(3.96) 


(3.97) 


(3.98) 


Thus  (3.95)  may  be  written  as 


and  by  the  definition  of  norm 


sup 

i 


PikLk 


P  L(t) 


(3.100) 


therefore , 


sup 

t 


/%(t,s) 


a  f(x*(s))ds 


<  SUP 
-  t 


P  L(t) 


(3.101) 


Hence  by  comparing  (3.101)  and  (3.95)  it  is  easily  seen  that  if 


sup 

t 


P  L(t) 


<  (1  -  K)  U 


(3.102) 


then  the  fixed  point  condition  is  satisfied. 

3. 3  The  Volterra  Series 

A  Volterra  series  is  a  functional  polynomial,  that  is  a  type  of 
power  series  which  gives  the  output  explicitly  in  terms  of  the  input. 
The  series  is  based  upon  the  Weierstrass  theorem  which  states  "any 
function  continuous  in  a  closed  interval  can  be  uniformly  approximated 
within  any  prescribed  tolerance,  over  the  interval,  by  some  polynomial 
-  erected  from  linear  elements" . 


' 


The  use  of  the  Volterra  series  as  a  representation  of  non-linear 
systems  is  justified  by  the  fact  that  if  the  output  of  a  system  is 
continuously  dependent  upon  its  input,  and  if  the  input  takes  its  values 
from  a  bounded  subset  of  a  normed  linear  space ,  then  the  output  can  be 
uniformly  approximated  by  a  Volterra  series.  If  the  series  converges 
then  the  system  exhibits  B.I.B.O.  stability.  The  deduction  that  a  system 
is  B.I.B.O.  stable  via  convergence  is  important.  A  convergence 
criterion  has  been  developed  by  Christensen,  [10],  based  on  the  contraction 
mapping  principle  and  the  definition  of  an  analytic  system.  This  criterion 
will  be  suitably  modified  to  suit  the  vector  matrix  form  utilized  here, 
and  will  be  presented  later  in  this  section. 

It  has  also  been  shown,  by  Trott  and  Christensen  [33]  ,  that  the 
Volterra  series  is  unique  provided  certain  conditions  are  satisfied: 

(1)  The  norm  of  the  input  is  bounded 

(2)  The  fixed  point  condition  holds 

(3)  The  contraction  condition  holds. 

A  natural  question  is  can  the  solution  of  (3.1)  be  expressed  as  a 
Volterra  series?  To  show  that  the  answer  to  the  above  question  is  in 
the  affirmative,  for  a  class  of  systems,  a  Volterra  series  will  now  be 
generated  via  (3.19) . 

By  combining  (3.54)  and  (3.55)  and  then  substituting  elements  of 
(3.12)  into  the  result  gives 


IlL^Uj)  -  ||  <  k||  u2 


(3.103) 


and  from  (3.19) 


' 


and  by  substituting  the  above  equations  into  (3.103)  results  in 


II  “3  -  “2 1 1  -  kII-2  ■  -ill ' 


and  by  similar  reasoning 


Hh2  '  %H  iKll“i  -  Hq II  • 

By  applying  the  axiom,  ||  a  -  b  ||  »J  |  a  1 1  -  ||  b|  |  to  (3.105)  gives 


similarly 


IIh3II  1  Kll h2  •  Hill +  IIh.2II- 


Now  substitute  (3.105)  and  (3.106)  into  (3.107)  then, 


ll“3lli  k2||  H-!  -  Ho II  +  Kll  Hx  -  Hjl  +  IlHj. 


A  general  form  of  equation  (3.108)  may  now  be  written  as 


u  ||  <(Tltif|u1 


u 
— 0 


-1 


i=l 


By  adding  11^11  to  each  side  of  (3.109)  and  by  applying  the 
la  ”  b  1 1  ^  |  j  a.  1 1  +  1 1  b  1 1  ;  then  ( 3 . 109 )  may  be  rewritten  as 


(3.104) 


(3.105) 


(3.106) 


(3.107) 


(3.108) 


(3.109) 


axiom 


"■  ■:""1  1 
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II 


u 

— n 


u 
— 0 


+  u.  -  u 
'—1  —o 


i=l 


<  u.  -  u  (1  +  k  +  K  +  — 
—  '  —l  — o  1 1 


—  +  Kn  1)<  U  (3.110) 


where 


0=||u||<7  7 


U.  (t) 

1 


(3.111) 


which  is  the  closure  of  the  region  in  which  the  solution  u*  is  to  be 
found . 

2  n_  i 

Since  (1  +  K  +  K  +  -  +  K  )  is  a  geometric  series  the  sum 

over  "n"  terms  is 


n-1 

S  =V  K1 

n  u 

i=0 


1  -  K~ 
1  -  K 


n 


(3.112) 


and  in  the  limit  as  "n"  -►  00 


lim  1  -  K 


n 


n-H»  1  -  K 


1 

1-K  r 


(3.113) 


because  o<K<l 

1  im 

now  substitute  (3.113)  into  (3.110)  and  let  u*  *  .  u  then 

—  rr^  — n 


(3.114) 


. 


which  implies  that 


IIh.!  "  hJI  <  (1  -  K)  U.  (3.115) 

If  (3.115)  is  compared  with  (2.118)  it  is  easily  seen  that  the 
inequality  (3.115)  is  a  statement  of  the  fixed  point  condition. 

It  will  now  be  shown  that  the  power  series  (3.110)  is  convergent. 
Rewrite  (3.110)  in  series  form  as  follows 


u 

— n 


u  || 
— o  11 


K 11% 


(3.116) 


now  if  (3.104)  and  (3.105),  and  so  on,  are  substituted  into  (3.116)  it 
can  be  rewritten  as 


U 

— n-1 


(3.117) 


and  if  the  axiom  ||a-b||  >_||a||  -  ||b  ||  is  applied  to  the  L.H.S.  of  (3.117) 
then, 


(3.118) 


. 


' 


therefore , 


(3.119) 


and  in  the  limit  as  "n"-*» 


u*  =  u  +  (u  -  u  )  +  (u  -  u.)  +  - 

—  —o  —l—o  —2—1 


(3.120) 


which  is  the  form  of  a  convergent  series. 

It  will  now  be  shown  that  the  power  series  (3.110)  converges  in  a 
region  where  o<K<l.  For  details  of  power  series  and  associated  topics 
see  typically  Courant  and  John  [28] ,  Lick  [29] . 

Substitute  (3.105)  into  (3.104)  and  write 


(3.121) 


then  by  induction 


(3.122) 


and  by  substituting  (3.115)  into  (3.122)  results  in 


(3.123) 


' 


' 


Now  apply  the  ratio  test  to  (3.118)  via  inequality  (3.123)  to  prove 
that  the  series  (3.119)  does  indeed  converge,  that  is, 


Kn(l  -  K) u 

Kn"1(l  -  K) U 


(3.124) 


and  because  K<1  the  series  converges. 

Thus  equation  (3.19)  has  a  unique  series  solution  in  the  region 
where  the  following  two  conditions  hold. 


(1)  From  (3.103)  i.e. 

Ill^tUz)  -  I1<ii1>ll£  k||u2  -  ujl  (3.125) 

and 

(2)  From  (3.115)  i.e.  Ilu..  -  u  II  <  (1  -  K)U,  and  because  of 

1 1  —1  — o  1 1 

equation  (3.19)  this  can  be  rewritten  as 

II T,  (u,)  -  u  II  <  (1  -  K)  U.  (3.126) 

u  — — j_  — o  1 

clearly 

(1  -  K) U  (3.127) 


is  the  region  of  uniqueness  of  the  solution.  Thus  the  series  (3.120) 
has  been  shown  to  be  convergent  in  the  region  where  o<K<l. 


*  . 


One  final  point  remains  to  be  developed,  before  it  can  be  shown 
that  equation  (3.1)  can  be  cast  into  the  form  of  a  Volterra  series,  and 
that  is  a  "convergence  criterion". 

Therefore,  we  quite  naturally  ask  the  following  question,  "When  can 
it  be  inferred  that  a  Volterra  series  exists  and  is  convergent  for  a 
given  system  if  the  contraction  mapping  principle  shows  that  system  to 
exhibit  B.I.B.O.  stability?" 

Christensen  [10]  has  answered  this  question  for  the  single  input- 
single  output  system,  his  method  will  be  extended  here  to  cover 
multidimensional  systems. 

The  answer  to  the  question  posed  above  is  simply,  that  the  given 
system  in  addition  to  having  a  unique  solution  must  also  be  analytic 

[6],  [7],  [35]-[37] . 

Specifically,  in  vector  form  the  Volterra  series  is  written  as 


x ( t )  =  g  +  /  h(x)y(t-x)dT  + 


L  ^2<Tl'T2)^<t_Tl)i(t"r2)dTldT2  + 


- +  /- — f°°  h  (x  , - x) y (t-x  ) 

-oo  -co  — n  1  n  —  1 


—  y (t-x  )dx. - dx 

—  n  1  n 


(3.128) 


where 

g  =  initial  conditions  on  x(t)  and  its  derivatives 
y ( t)  =  system  input 


x(t)  =  system  output 


* 


' 
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which  gives  the  output  x^(t)  for  a  given  input  y(t)  for  the  system  in 
question. 

Brilliant  [7]  has  shown  that  if 


1' 


t  . )  dT, - dx .  <  00 

l  1  l 


for  all  such  that  (3.230)  can  be  cast  into  the  form 


00 


i  iD'Ms" 


(3.129) 


n=o 


and  if  the  right  hand  side  of  (3.129)  is  a  convergent  series,  then  the 
given  system  is  analytic. 

Now  consider  the  series  generated  in  (3.12) .  This  series  refers  to 
system  (3.1)  and  it  is  readily  seen  that,  with  the  aid  of  the  material 
developed  in  this  section,  the  series  can  be  cast  into  the  form  of 
(3.129) ,  and  is  convergent  in  the  region  considered.  Thus  the  system 
which  is  represented  by  equation  (3.1)  is  an  analytic  system. 

In  conclusion,  consider  once  again  equation  (3.1),  if  a  solution  is 
obtained  for  the  equation  by  the  use  of  the  contraction  mapping 
principle,  then  this  solution  is  unique.  If,  in  addition,  this 
solution  can  be  cast  into  the  form  of  (3.129)  then,  (3.1)  represents  an 
analytic  system.  Thus,  it  can  be  stated  that  a  Volterra  series  solution 
exists  for  the  system. 

It  will  now  be  shown  that  equation  (3.1)  can  be  cast  into  the  form 
of  a  Volterra  series.  Substitute  (3.15)  in  (3.16)  and  write 


< 


<  ■•< 


-  ,  j  ;•  i  u 


* 


u2(t)  = 


/%( t,s) 


a 


f(x(Sl) 


/%( t,s) 


a  f(x(s2))dsids2  (3.130) 


sinilarly  with  u^ (t)  ,  etc. 

Now  substitute  (3.120)  into  equation  (3.5)  and  write 


x*(t)  =  g  +  Z  +  u  +  (u.  +  u  )  + 
—  —  —o—l—o 


- +  (u 


-  u  )  + 
— n-1 


$(t)x  +  f  $(t,s)  B  y(s)ds 

—  —o  o  —  - 


(3.131) 


where 


g  =  $ (t)x  (3.8) 
—  —  —o 


%_  =  /S(t,s)  B  y(s)ds  (3.9) 


u  =  0  (null  vector) 
—o 


u.  -  u  =  f  $(t,s)  a  f(x(s))ds, 
—1  — o  o  —  - 


Similarly  with  u2  -  u^  and  so  on. 

Clearly  equation  (3.131)  is  the  Volterra  series 


Conclusion: 


This  section  has  clearly  shown  that  for  a  stable  non-linear  system 
we  can  represent  the  output  as  a  convergent  power  series  if  the 
contraction  mapping  and  fixed  point  conditions  are  satisfied.  Further¬ 
more,  if  the  system  equation  is  analytic  the  resulting  power  series 
representing  the  system  output  is  a  Volterra  series . 

3.4  The  Solution  of  a  Non-linear  System 

To  illustrate  and  amplify  the  method  which  has  been  developed  in 
the  preceeding  pages,  the  solution  to  a  typical  problem  will  now  be 
offered.  Previously,  this  same  problem  has  been  solved  by  Christensen 
[26],  but  by  a  different  method.  It  will  be  interesting,  in  the 
sequel,  to  compare  the  results  previously  obtained,  with  those  obtained 
here. 

The  system  in  question  is  represented  by  the  following  non-linear 
differential  equation 

x  +  x  +  x  -  ax3  =  y(t).  (3.132) 

Christensen  [27]  has  solved  this  equation  via  a  Volterra  series  by 
considering  it  as  representing  a  single  input/single  output  non-linear 
system.  However,  in  this  section  the  equation  will  be  solved  by  casting 
it  into  the  form  of  (3.1)  and  utilizing  the  multidimensional  Volterra 
series  approach  previously  developed.  The  form  of  (3.1)  will  be 
obtained  by  methods  stated  in  Ogata  [30],  that  is: 

(i)  normal  state  form  (series  method) 

(ii)  Heavisides  decompositon  (parallel  method) 


* 


- 


, 


-  • 


3.4.1  Normal  State  Form 


Equation  (3.132)  can  be  rewritten  as 


which  can  be  written  in  vector-matrix  form  as 


o  1 
-1  -1 


+ 


y(t) . 

(3.133) 


Clearly  (3.133)  is  of  the  same  form  as  (3.1)  the  solution  of  which  is 
given  by  equation  (3.2)  . 

The  state  transition  matrix  $(t,s)  of  equation  (3.2)  is  found  from 


$ (t,s) 


(3.134) 


f  "1 

where  cA-  ( - )  is  the  inverse  Laplace  transform. 

Therefore,  from  (3.133) 


$ (t,s) 


m  +  l 
2 

m  +  m  +  1 
-  1 

m2  +  m  +  l 


1 

2 

m  +  m  +  l 


m2  +  m  +  1 


(3.135) 


' 


' 


. 


where 


. -1 


m  +  i 


m  +  m  +  i 


— Mt-s),  SJ  i  Sin  Jl  (t-s) 

-  e  (cos  -(t-s)  + j  2  ) 


(3.136) 


and 


»12(t's> 


_  > 


-1 


m  +  m  +  i 


=  e 


-*8  (t-s) JT 


Sin  (t-s)  . 


(3.137) 


Blit  =  "  ^21^t/S^  therefore. 


A  v  ~h  (t-s)  0 .  x/lT  \ 

$21  t,S  =  "  e  Sin  j(t-s)  > 


(3.138) 


and  finally 


-1 


*22(t'S)  =<^ 


m 


m  +  m  +  x 


=  e‘'5(t‘s)  (Cos  '/|(t's)  'Jl  Sln  7|(t-s>) 


(3.139) 


It  was  shown  in  equation  (3.43)  that 


=  °°|$> .  (t,s)  |  ds 

o  1  11 


t 


(3.140) 


Similarly  with  P^/  ^21 r  ^22*  Rewriting  (3.136)  in  polar  form  results 
in 


$ll(t/s)  =  R  ea^t  S^Sin(b(t-s)  +  0)  (3.141) 


where 


R  =  1*15  =  2//J 

b  =  .866  =  J~3/2 
0  =  1*05  radians 
a  =  -• 5  . 


(3.142) 


Let 


b(t-s)  +  0  =  bz 


(3.143) 


Then 


t-s  =  z  -  0/b 


(3.144) 


now  readjust  the  limits  of  integration  to  be  in  terms  of  z  rather  than 
s,  then  from  (3.144),  when 


s  =  o  then  z  =  t  +  0/b 
therefore  when 

s  =  t  =  o  then  z  =  0/b  (3.145) 

and  when 

s  =  t  -*  00  then  z  -*■  00 , 


therefore  the  upper  and  lower  limits  are  00  and  0/b  respectively. 


' 


Substituting  (3.143)  and  (3.144)  into  (3.141)  results  in 


*ll^t,S^  =  R  e  a9//b(eaZSin  bz)  . 


(3.146) 


Now  substitute  (3.146)  into  (3.140)  and  adjust  the  limits  of 
integration  in  accordance  with  (3.145)  with  the  result  that  (3.140)  can 
now  be  written  as 


P11  =  R  e’a8/b6/JeaZanbz|dz 


_  -a0/b  .  .°°  azi  .  ,  i  , 

=  R  e  (/  e  Sinbz  dz 

o  1 


0/b 

/  eaz|  SLnbzIdz) 
o 


(3.147) 


which  may  also  be  written  as 


11 


=  R 


e-a6/b(I. 


-  V 


(3.148) 


where  I  and  I  are  the  integrals  in  the  brackets.  The  integral  I  is 

i.  ^ 

evaluated  first 


=  /^e32 1  Sinbz  |  dz  , 
o  1  ' 


(3.149) 


but  since 

o  <  0/b  <  ir/b 


(3.150) 


The  absolute  value  sign  of  (3.149)  may  be  removed  and  integration 
performed  directly,  that  is 


‘ 
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.0/b  az„. 

I ,  =  /  e  Sm  bz  da 
1  o 


az 


2  v2 

a  +  b 


(aSin  bz  -  bCos  bz) 


6/b 


a0/b 


=  2  2 
a  +  b 


(aSin  0  -  bCos  0)  + 


2  v2 

a  +  b 


By  substituting  the  values  from  (3.142)  into  equation  (3.151) ,  . 


be  evaluated  as 


a0/b 

X  =  - - 

1  2  ,2 
a  +  b 


(aSin  0  -  bCos  0)  + 


2  2 
a  +  b 


=  • 395 . 


Now  consider  the  second  integral  of  (3.148)  namely  I, 


.°°  az  i  i 

I.  =  /  e  sm  bz  dz 
2  o  1  1 


which  is  solved  in  the  following  manner. 


A 


\ 


az , 
e  sinbz 


1  /  \ 


J. 


/ 


it/b  2-n/b  3-n/b  / 


i 


nn/b 


az 


Relationship  Between  z  and  e  | sinbz 


(3.151) 


can 


(3.152) 


(3.153) 


Figure  3 : 
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From  Figure  3 


00 

.X1  r  (2n+l)  Tr/b 
/  .  2m\/h  e  ZSin  bz  dz 
n=o 


00 


/ 

<  _ 


,(2n+2)7r/b  az 
(2n+l)TT/b  6 


sin.  bz  dz 


n=o 


(3.154) 


To  determine  I  in  (3.154)  we  find 


az 


r(2n+l)Tr/b  az  .  ,  - 

in*/b  e  Sln  bz  dz  =  a2  +  b2 


(aSin  bz  -  bCos  bz) 


(2n+l)  ir/b 
2n7r/b 


2  .2 

a  +  b 


2naTT/b 


(1  +  e  '  )  (3.155) 


and 


(2n+2)  Tr/b 
{2n+l)TT/b  e 


Sin  bz  dz 


az 

e 


(asin  bz  -  bCos  bz) 


(2n+2)  Tr/b 
(2n+l)  TT/b 


-b 


2  b,2 

a  +  b 


e  (2n+l)  a-rr/b^ 


+  e  aT/b) . 


(3.156) 


If  we  now  substitute  (3.155)  and  (3.156)  into  (3.154)  then 


00 


x*mL 

n=o 


b  2na7r/b/,  air/b. 

- - -  ,  e  (1  +  e  ) 

a  +  b 


00 

v— •  b  (2n+l)  au/b ..  air/b. 

+  \  ~2 -  2  e  (1  +  e  ) 

Z-i  a  +  b 
n=o 
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=  22 
a  +  b 


(1  +  eaTr/b)y’  (e2na,T/b  +  e(2n+l)air/b) 


n=o 


=  22 
a  +  b 


1  +  eaTr/bh  '  e2na1T/b 


(3.157) 


n=o 


For  convenience  let 


2aTT/b 

r  =  e 


(3.158) 


thus 


00  00 


n  _  '\p  e2na7r/b 


)  r 

L>  L 


(3.159) 


n=o  n=o 


Clearly  (3.159)  is  a  geometric  series  and  the  partial  sum  to  "n"  terms 


is 


.  n+1 

s  =  1  ~  r 
n  1  -  r  ' 


(3.160) 


and  from  the  values  given  in  (3.142)  it  is  found  that 


a<o 


(3.161) 


,  ^  ,  2a7r/b  . . 

therefore,  because  r  =  e  then 


r<l  , 


(3.162) 


,  n+1  .. 

thus  as  nr*50,  r  -+o,  thus 


% 


(3.163) 


S 

rr*» 


1 _ 

1  -  r  ' 


Hence  substituting  (3.158)  into  (3.163)  results  in 


S 

n-x» 


1 

1 


00 

v - i 


2a7r/b 


2na7r/b 


n=o 


Now  substitute  (3.164)  into  (3.157)  and  write 


I0  =  J2  t  J2  (1  +  ea7T/b)2  2air/b 


2  a  +  b 


1  -  e 


1  +  e 


aTr/b 


(.  air/b 


). 


=  2  2  1  -  e 

a  +  b 


(3.164) 


(3.165) 


Then  by  substituting  values  from  (3.142)  into  (3.165)  can  be 
evaluated  as 


I 


2 


*866 _ 

2  2 
•5  +  *866 


.  ,  -•5tt/«866 

1  4-  e ' 

,  -•5tt/«866 

1  -  e 


(3.166) 


=»  «866( 


1*16 

•838 


=  1*20  . 


Substituting  (3.166)  and  (3.152)  into  (3.149)  results  in 


\ 


(1*20  - • 395) 


(3.167) 


Re 


-a0/b 


=  Re 


-a0/b 


(•805) 


9 


and  if  values  from  (3.142)  are  now  substituted  into  (3.167),  then  P  is 
found  to  be 


P 


11 


1*15 


-• 5xl*05/»866 

x  *805  e 


(3.168) 


=  1-71  . 


Similarly  with  P^  where 


(3.169) 


Now  rewrite  (3.137)  in  polar  form  and  by  utilizing  the  values  given  in 
(3.142),  equation  (3.169)  can  be  cast  into  a  form  similar  to  (3.147). 
Thus  (3.169)  may  be  rewritten  as 


as 

/  e 
o 


Sinbz 


ds 


(3.170) 


which  is  clearly  of  the  same  form  as  (3.153)  the  solution  of  which  is 
(3.166);  therefore 


P 


12 


1*20. 


(3.171) 


■ 


By  comparing  (3.137)  and  (3.138)  it  is  seen  that 


P 


12 


(3.172) 


therefore , 


P  =  -  1-20, 
21 


(3.173) 


The  last  element  of  the  I?  matrix,  namely  p22'  determined  in  a  manner 
identical  to  that  used  in  the  determination  of  P  .  T^at  is, 


,  _  a0/b.  az„.  ,  . 

$22  =  Re  (e  Sinbz) 


(3.174) 


therefore , 


P22  =  Rea0/b;6/b|eaZSinbz|dz 


=  Rea0/^  (/°°eaZ  |  Sinbz  |  dz  -  /  0//t>eaZ  |  Sinbz  |  dz) 
o  1  o  1 


-  -  v 


(3.175) 


Evaluating  1^ 


az 


h  = 


2  ,2 

a  +  b 


(aSinbz  -  bCosbz) 


-0/b 


or 


-a0/b  b 

- - —  (aSin0  +  bCos0)  +  — - - 

a2  +  b2  a  +  b 


(3.176) 


By  direct  substitution  of  values  from  (3.142)  into  equation 
(3.176),  it  is  found  that 


I1  =  -1-83  (-*5  Sin (1* 05)  +  *866  Cos(l*05))  +  *866 


=  -866  , 


(3.177) 


1 2  can  be  evaluated  by  utilizing  equation  (3.165)  which  is  rewritten 
here  for  convenience 


I2  2,2 


1  +  ea7T/b 

- )  , 


a  +  b  ,  a7r/b 
1  -  e 


and  in  accordance  with  equation  (3.166)  it  is  found  that 


I2  =  1-20  . 


(3.178) 


Now  substitute  (3.178)  and  (3.177)  into  (3.175),  and  write 


P22  =  Rea6/b(l*20  -*866) 


(3.179) 


then  by  substituting  values  from  (3.142)  into  (3.179)  P22  is  found  to  be 


P  „  =  1*15  x  »334e 
22 


-•5  x  1 • 05/*  866 


=  .209  . 


(3.180) 


The  elements  of  the  P  matrix  have  now  been  evaluated,  thus 


. 


‘ 
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(3.181) 


1*71  1*20 

-1*20  *209 


(3.182) 


where  values  of  the  elements  of  are  given  by  (3 . 168) , (3 . 171) ,  (3.173) 
and  (3.180) . 

The  "size"  of  the  vectors  which  satisfy  the  contraction  mapping  and 
fixed  point  condition  can  now  be  determined.  The  contraction  condition 
(3.55)  requires  that  the  norm  of  Pz^(t)  be  less  than  one.  The  £  matrix 
has  already  been  found  (3.182),  now  z_(t)  will  be  determined  from  (3.44) 
and  (3.133);  therefore, 


(3.183) 


Thus  the  resulting  matrix  product  of  equation  (3.47)  is 


P  z 

<  | a |  sup 

1*71  1*20 

o  o 

-1«20  *209 

,  2 

3x  o 

(3.184) 


which  reduces  to 


<_  |a|  3 *60X^2 


(3.185) 


■ 
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where 


-*  <  sup  sup 
—  —  i  t 


x.  (t) 
1 


and  from  (3.55)  it  follows  that 


4,  r\ 

|  a  |  3  «60X  <  K  <  1. 


Similarly  with  the  fixed  point  condition,  equation  (3.102), 
L  may  be  obtained  by  substituting  elements  of  (3.133)  into 


is 


L  = 


sup 


a 


By  utilizing  the  P  matrix  (3.182)  we  find  that 


P  l||  <_  |  a  |  sup 


1-71  1*20 


-1*20  • 209 


which  reduces  to 


||  P  L_||  <_  |  a  |  1«20X  3 
(see  equation  (3.186)  for  norm  on  X  ) . 
Substitute  (3.190)  into  (3.102)  and  write 


1  |  1«20X*3  <  (1  -  K)  U  . 


(3.186) 


(3.187) 

the  vector 
(3.98) ;  that 

(3.188) 


(3.189) 


(3.190) 


a 


(3.191) 


■ 

And  from  (3.187)  X  can  be  evaluated  as 


_ * 

X  < 


K  *5 

3  •  60  |  ot  | 


(3.192) 


and  from  (3.191) 


/d  -  K)  Ux  1/3 
('  T"*  2 0 1  ot  |  } 


(3.193) 


now  let 


K  =  *6 
U  =  *2 
a  =  1 


Then  from  (3.192) 


<  *408 


(3.194) 


and  from  (3.193) 


X  <  • 405 


(3.195) 


taking  the  supremum  of  (3.194)  and  (3.195)  it  is  found  that. 


_* 

X  <  *405 


(3.196) 


Hence  a  bound  on  the  output  vector  has  been  determined,  via  a  Volterra 
series . 

I 

3.4.2  Heavisides  Decomposition 

It  is  generally  recognized  that  the  definition  of  state  variable 
relations  is  not  unique.  The  state  variable  relations  in  this  section 
will  be  obtained  via  Heavisides  decomposition. 

Equation  (3.132)  can  be  represented  in  the  following  diagramatic 

form 


y  (s) 


\  x(s) 


Figure  4:  Block  Diagram  of  Equation  (3.132) 
_ 1 

Furthermore  2  ,  can  be  decomposed  as 

m  +  m.  +  1 


m2  +  m+  i  m+  x  m  +  X 

JL  *— > 

where 


(3.197) 


(3.198) 


' 


’ 

' 

• 
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and 


(3.199) 


therefore , 


(3.200) 


and 


(3.201) 


The  system  of  Fig.  4  can  now  be  represented  as  follows. 


Figure  5:  Parallel  Form  of  Equation  (3.132) 
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where  x  =  c„x,  +  c  x 
—  11  2  2 


From  Fig.  5  it  is  seen  that 


=  y(t)  -  a (x)  A^x^ 


x2  =  y(t)  -  a (x)  -  A^, 


(3.202) 


(3.203) 


Now  substitute  (3.202)  into  (3.203),  and  write  the  resulting  equations 
in  matrix  form  as  follows: 


~alclxl  +  C2X2)3 

+ 

y(t) 

-a(clXl  +  C2X2)3 

y  (t) 

(3.204) 


By  comparing  (3.204)  and  (3.133)  it  is  seen  that  they  are  of  the  same 
form,  thus  the  procedure  which  was  utilized  in  section  3.4.1  will  be 
used  again  in  this  section. 

The  P  matrix  is  determined  first  and  is  found  to  be 

/“|e"Xlt|dt 
P  =  0 

o 

-  xi  0 

1 


°°l  —At 
/  e  2 
o  1 


dt 


(3.205) 


■ 


The  elements  of  the  z  matrix  are  constructed  from  (3.204)  via  equation 
(3.45) ,  typically 


therefore , 


(3.206) 


z 


1 


3fl 

+  I  c  I 

3fi 

3xl 

1  2 

3x2 

o)  (3.207) 


which  differs  from  only  in  the  subscript  attached  to  "9f",  and 


cll  =  |c2 


1. 
J  3 


(3.208) 


also 


8fl 

3£1 

3X1 

3X2 

3 (c1x1  +  c2x2) 


(3.209) 


Thus , 


z 


1 


(cixi 


+  c^x  ) 
2  2 


(3.210) 


< 


o)  . 


(3.211) 


The  matrix  product  of  equation  (3.47)  can  now  be  written  as 


. 


' 
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sup 

t 


P  z 


sup  sup 
i  t 


o 


1 

X. 


6 1  a  |  |  x  | 

^3 

6 1  a. |  |x| 

J  -3 


and  because 


(3.212) 


(3.213) 


then  (3.212)  reduces  to 


sup 

t 


P  z 


i  i  — *  2 

6|a|X 

<  - — - 

3 


(3.214) 


substitute  (3.214)  into  (3.55)  and  write 


6  a  X 


<  K<1 


(3.215) 


therefore , 


_ * 

X  < 


( - T- 

v  3-46  a 


(3.216) 


The  elements  of  the  L  vector  can  be  constructed  from  (3.213)  via  (3.98) , 
typically 


f  (x  ( t)  ) 
k  — 


(3.217) 
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therefore 


L 


i  i  sup 

h  i  H  t 


(C1X1  +  C2X2) 


<  a 


sup 


x 


(3.218) 


Thus  the  matrix  vector  product  of  (3.102)  can  now  be  written  as 


a 


sup  sup 
i  t 


< (1  -  K)  U 


which  reduces  to 


(3.219) 


a 


X*3<(1  -  K)  U 


(3.220) 


therefore , 


(1  -  K)U) 1/3 


(3.221) 


now  let 


K  =  *6 
U  =  *2 
a  =  1  . 


Then  from  (3.216) 


X  <  *416 


(3.222) 
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and  from  (3.221) 


X  <_  *430 ,  (3.223) 

taking  the  supremum  of  (3.222)  and  (3.223)  it  is  found  that 

X*  <_  *416  (3.224) 

Hence  a  bound  on  the  output  vector  has  been  determined  by  the  Volterra 
series  method. 

The  bound  on  the  input  vector  y(t)  will  now  be  determined. 

Consider  equation  (3.5)  once  again,  if  the  initial  conditions  are 
allowed  to  be  zero  then  the  equation  may  be  written  as 


x*  *  +  u*.  (3.225) 

Take  the  norm  of  (3.225)  and  write 

ft 

X  <_£_  +  U  ,  (3.226) 

from  the  material  in  sections  3.1  and  3.2  it  can  be  clearly  seen  that 

£  <_  sup|p_  y}  •  (3.227) 

Thus  £  can  be  determined  from  the  £  matrix  (3.182)  and  the  y  vector 
(3.133) ,  that  is 


* 

< 

) 

' 
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Z  1  SUP 


— 

1*71  1-20 

o 

-1*20  • 209 

y_ 

(3.228) 


<_  l«20y 


(3.229) 


where 


Y  <  SUP  SUP 
- i  t 


yi(t) 


(3.230) 


From  (3.229)  £  can  rewritten  as 


Z  1  HX 


(3.231) 


where 


H  =  1*20, 


(3.232) 


then  (3.226)  can  be  rewritten  as 


X 


<  HY  +  u 


(3.233) 


Substitute  (3.233)  into  the  contraction  condition  (3.192)  and  write 


HY  +  u  < 


(3.234) 


and  by  substituting  the  values  assumed  for  K,  a,  and  U  into  (3.234)  Y 
is  found  to  be 


Y  <  *173  . 


(3.235) 
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From  the  fixed  point  condition  (3.93)  ,  and  equation  (3.15)  is  is 
easily  shown  that 


HY  < 


,  U-K) 

1  H I  06 1 


•) 


(3.236) 


and  by  substituting  the  values  assumed  for  K,  a,  and  U  into  (3.236),  Y 
is  found  to  be 


Y  <  *375  .  (3.237) 


Taking  the  supremum  of  (3.235)  and  (3.237)  it  is  found  that 


Y  <  *173  .  (3.238) 


Hence  a  bound  on  the  input  vector  has  been  determined. 


Therefore,  by  the  contraction  fixed  point  principle 


Y  £  -173 
— *  <  *405  . 

X 


(3.239) 


Conclusion : 

By  normal  state  matrix  methods  and  the  Volterra  series  the  system 
considered  has  been  shown  to  be  B.I.B.O.  stable. 

Now  determine  the  bound  on  the  input  vector  for  the  parallel  system 
i.e.  section  3.4.2.  Thus  £_  can  be  determined  from  the  I?  matrix  (3.205) 


’’ 
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and  (3.213)  and  the  Y  vector  (3.204),  that  is 


X  1  sup 


1 

o 


y 

y 


<  Y 


(3.240) 


where  Y  is  defined  by  (3.230) 


and 


H  =  1  . 


(3.241) 


If  we  now  substitute  (3.241)  into  (3.234)  then 


Y  <  *226, 


(3.242) 


also  if  we  substitute  (3.241)  into  (3.236)  then 


Y  <  *430 


(3.243) 


and  since 


•226  <  *430 


This  implies  that 


Y  <  *226  . 


(3.244) 


Therefore  by  the  contraction  fixed  point  principle 


Y  <_  *226 
X*  <  *416 


(3.245) 


Conclusion ; 

The  parallel  method  of  erecting  the  state  equations  and  the 
subsequent  use  of  the  Volterra  series  has  shown  that  B.I.B.O.  stability 
exists . 

In  the  worked  example  the  A  matrix  was  a  constant,  however,  if  A  is 
time  dependent  then  the  commuting  rule  which  is  invoked  in  linear 
systems  must  be  invoked  here,  appropriately,  since  a  linear  system  is  a 
special  case  of  a  nonlinear  system. 


; 


CHAPTER  IV 

SAMPLED  DATA  CONTROL  SYSTEMS 

4 . 0  Introduction 

A  very  important  sub-class  of  control  systems  are  those  of  the 
sampled  data  type.  Sampled  data  control  systems  consist  of  dynamic 
systems  whose  inputs  are  either  time  sequences  or  are  important  only  at 
specific  instants  of  time. 

The  two  types  of  sampled  data  systems  considered  here  are  defined 

as , 

Type  " 1 " : 


Figure  6:  Non-linear  sampled  data  system  with  data  hold. 

The  error  signal  e(t)  is  sampled  and  fed  into  the  data  hold  which 
maintains  a  steady  input  to  the  linear  plant  during  the  in-between 
sample  periods. 
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■ 


10  3 


Type  "2": 


'  / 


The  input  to  the  linear  plant  e*(t),  appears  as  a  series  of  pulses. 

Thus  the  plant  has  an  input  only  during  sample  periods. 

The  material  developed  in  the  preceeding  sections  will  be  extended 
to  cover  discrete  data  systems.  The  components  of  the  systems  are  still 
describable  by  differential  equations,  but  because  the  signal  is 
discrete  a  set  of  difference  equations  will  be  generated  from  the 
original  differential  equations.  It  is  well  known,  [16],  [30]  ,[32], 
that  difference  equations  represent  discrete  systems  in  a  manner 
analogous  to  the  way  differential  equations  represent  continuous  systems. 

4 . 1  Determination  of  Region  of  Stability  for  a  Type  "1"  System 

Consider  equation  (3.1)  which  represents  a  continuous  non-linear 
system,  it  is  repeated  here  for  convenience 


x(t)  =  Ax (t )  +  By(t)  +  a  f(x(t)). 


(4.1) 


. 
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The  solution  of  (4.1)  is  well  known. 


jc(t)  =  $_(t)jc(o)  +  (t ,  s)  By  (s)  ds 

+  ^$_(t,s)  a  f (x(s))ds.  (4.2) 

A  method  of  descretizing  (4.2)  has  been  developed  by  Ogata,  [30], 
it  is  repeated  here  for  reasons  of  continuity. 

Let  t  =  (n  +  1 ) T  in  (4.2),  thus 

(n+1) T 

x(  (n  +  1) T)  =  £(  (n  +  l)T)x(o)  +  /'  (  (n  +  l)T,s)  B^y(s)ds 

+  /(n+1)T$((n  +  1) T , s)  a  f(x(s))ds;  (4.3) 


Let  t  =  nT  in  (4.2)  then 


nT 

x(nT)  =  $_(nT)x(o)  +  /  £(nT,s)  B  y(s)ds 


■nT1 

+  /  £(nT,s)  a_  £(x  (s)  )  ds.  (4.4) 


Premultiply  (4.4)  by  $(T) 


nT 

£(T)x(nT)  =  £(  (n  +  l)T)x(o)  +  /  <M  (n  +  l)T,s)  B  y(s)ds 

nT 

+  /  $_(  (n  +  1)  T ,  s)  a_  f_(x(s) )  ds . 


(4.5) 


' 
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Now  subtract  (4.5)  from  (4.3) 


( n+1 } T 

X((n  +  1)  T)  -  <MT)x(nT)  =  '  (  (n  +  l)T,s)  B  y(s)ds 


(n+1) T 

+  /  $  (  (n  +  1) T , s)  a  f  (x (s)  ) ds ;  (4.6) 


Therefore , 


(n+1) T 

x((n  +  1) T)  =  ^(T)x(nT)  +  /  $((n  +  l)T,s)  B  y(s)ds 


(n+1) T 


$  (  (n  +  1)  T ,  s) 


a  f (x(s) )ds. 


(4.7) 


Now  let 


-t  =  nT-s 


(4.8) 


Therefore , 


and 


$((n  +  l)T,s)  =  3>(T,x) 


dx  =  ds 


(4.9) 


(4.10) 


The  upper  and  lower  limits  of  integration  change  from  (n+l)T  and  nT 
to  T  and  0  respectively.  Thus 


(n+1) T  T 

/  $((n  +  1) T , s) - ds  =  /  $ (T,x) — dx 

nT  —  o  — 


(4.11) 


- 


■ 

’ 


this  follows  from  the  preceeding  remarks;  and  by  making  the 
necessary  substitutions  into  (4.7) .  Eguation  (4.7)  can  now  be  written 
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as , 


T 

x(  (n  +  1 ) T)  =  $(T)x(nT)  +  /  $(T,x)B  y(x  +  nT)dx 

—  o  —  —  ■=- 

T 

+  /  $_(T,x)  a.  _f(x_(x  +  nT)  ) dx  .  (4.12) 


But 


h(x)  =  h(nT)  n  =  0,1,2 -  (4.13) 


where 

nT  <_  x  <  (n  +  1 ) T .  (4.14) 

(4.15) 

(4.16) 

Since  y  (nT)  and  f_(?i(nT) )  are  constant  between  sampling  instants 
they  may  be  taken  outside  the  integrals,  thus 

T 

x  (  (n  +  1)  T)  =  jMT)x(nT)  +  /  J^(T,x)Bdx  y(nT) 

T 

+  /  $  (T , x)  a  dx  f(x(nT)). 


Therefore , 

Y_(t  +  nT)  =  y(nT) 
f(x(x  +  nT) )  =  f(x(nT)). 


(4.17) 


. 


& 


' 


Equation  (4.17)  can  be  considered  as  representing  an  updated 
system  at  the  start  of  each  sampling  instant.  The  bound  on  x((n+l)T) 
can  be  determined  from  equation  (4.17)  for  some  "n" ,  by  utilizing  the 
methods  of  Chapter  3.  However,  the  bound  so  determined  is  strictly 
local  to  that  sample.  What  is  actually  required  is  the  bound  on  the 
output  over  the  range  of  samples,  for  n>o.  Therefore,  on  this 
premise  equation  (4.17)  must  be  modified  such  that  j£((n+l)T)  is  related 
directly  to  jc(0) ,  meaning,  the  initial  conditions  at  n=0.  Thus  a  table 

of  Jc((n+1)T)  for  n=0,l,2 - ,m-l,  will  be  constructed  from  which  the 

general  form  of  x((n+l)T)  =  x(mT)  can  be  found  [32]. 

Because  Jc((n+1)T)  is  a  sampled  output  a  superscript,  a  star(*), 
will  be  added  to  equation  (4.17)  to  indicate  sampled  functions.  Thus 
(4.17)  is  rewritten  as 

\ 

x*  (mT)  =  x*  (  (n  +  1)T)  =  $^(T)x*(nx) 

T 

+  f  $_(t,x)  Bdx  y*  (nT) 

T 

+  /  $.(T,x)  a  dx  f(x*  (nT)  )  .  (4.19) 

If  a  =  0  (the  null  matrix)  then 

T 

x*  (mT)  =  x*((n  +  1)T)  =  <MT)x*(nT)  +  f  £(T,x)B  dx  y*  (nT).  (4.20) 

Which  is  the  discrete  equation  for  a  linear  system. 

Now  let  n=0  in  equation  (4.19)  then 


. 


' 


■ 
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T 

x*(T)  =  £(T)x*(0)  +  /  <£(T,x)  B  dt  y*(0) 

T 

+  /  £(T,x)  a  dx  f_(x*(0)). 


Let  n=l  in  (4.19) 


T 

X*(2T)  =  $(T)x*(T)  +  /  ^(T,x)  B  dx  y*(T) 

T 

+  /  $_(T,x)  a  dx  £(x* (T) )  . 


Now  substitute  (4.21)  into  (4.22) 


T 

x*(2T)  =  $2(T)x*(0)  +  $_(T)/  <MT,x)  B  dx  y*(0) 

T  T 

+  /  $(T,x)  B  dx  £*(T)  +  i(T)/  £(T,x)  a  dx  £(x*(0) 

T 

+  /  £(T,x)  a  dx  £(x*(T) ) 


and  so  on;  until  after  "m"  terms. 

m-1 

T 

x*  (mT)  *  $m(T)x*(0 )  t^1£m”1"1(1’)^  i(T,x)  B  dx  £*(iT) 

i=o 

m-1 

+  \  '  |m“i-1(T)/  £(T,X)  a  dt  f(x*(iT)). 
i=o 


(4.21) 


(4.22) 


(4.23) 


(4.24) 


The  discrete  state  transition  equation  (4.24)  is  analogous  to,  and  a 
special  case  of,  its  continuous  counter  part,  equation  (4.2).  Therefore, 
(4.24)  can  be  solved  by  methods  analogous  to  those  used  in  the  solution 
of  (4.2).  The  necessary  equations  will  be  suitably  modified  to 
accommodate  a  discrete  data  system  fitted  with  a  data  hold  device. 

It  is  seen  that  the  output  x* (mT)  is  the  summation  of  all  the  past 
contributions y  resulting  from  input  pulses  ranging  from  t=0  to  t=mT. 

The  upper  limit  of  the  summation  in  (4.24)  can  be  extended  to  infinity 
because  ^((m-l-i)T)  =  0  if  i>m-l.  Therefore  (4.24)  can  be  written  as 

OO 

T  . 

x*  (mT)  =  $m(T)x*(0)  +  $1  (T)  /  (T,  x)  B  dx  y* (iT) 

i=o 

OO 

T  . 

+  ,  3*1  (T)  /  ^(TjX)  £  dx  f_  (x*  (iT)  )  .  (4.25) 

i=o 


Clearly  (4.25)  is  of  the  same  form  as  (3.11),  that  is,  a  linear  system 
with  a  perturbation.  Thus  the  solution  of  (4.25)  is  obtained  by 
casting  it  into  the  form  of  (3.28),  the  discrete  version  of  (3.28)  is 


r(x  *)  -  r(x  *) 

OO 

\  $1(T)  E (T) 

1 

*r~» 

4-1 

CO  c 

1 

(u_ 

-  u  ) 

—  — 2  - 1 

i=o 

Lx. 

—2 

—1 

00 


< 


'  ‘  • 

(T) 

4  ... . 

i=o 


(4.26) 


T 

where  E_  =  /  _$(T,x)  £  dT. 


% 


» 
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The  subscript  attached  to  the  vector  x*  indicates  the  degree  of 

st 

approximation,  i.e.  x  *  is  the  1  approximation  to  the  final  solution 
x*. 

Let 


P 


00 

r- 

\  (T) 

.  .  .1 

i-o 


(4.27) 


the  upper  limit  of  the  summation  in  (4.27)  has  been  extended  to  infinity 
to  cover  the  general  case.  However,  the  resulting  summation  is  a 
geometric  series,  and  summing  over  an  infinite  number  of  terms  is  easy 
to  handle  providing  the  ratio  between  successive  terms  is  less  than  one. 
Thus  (4.27)  may  be  written  as 


P 


1=0 


<J>1(T) 


(4.28) 


and  a  single  element  of  the  P  matrix  may  be  written  as 


00 


i=o 


(T) 


At  the  same  time  make  the  following  substitution,  that  is 


z(T) 


sup 

T 


E(T) 


E(T) 


< 


sup 

T 


t 


(4.29) 


Ill 


Therefore 


z.  (T)  < 


sup 


3m  —  T 


Ejk 


3f 


' 


(4.30) 


where 

l<m<k 

thus 

n 

sup 

P 

k 

*3 

II  "2  '  HJI 


j=l 


$1(T) 


sup 

T 


E  (T) 


1=0 


3f 


U  -  U  1.  , 

-2  -l"  ' 


||  ,  (4.31) 


and  by  the  definition  of  the  norm, 


sup 

k 


n 


P..Z. 
kj  3m 


j=l 


P  Z  (T) 


(4.32) 


We  now  have  sufficient  information  to  determine  the  fixed  point  and  the 
contraction  condition. 


4 . 2  A  Convergence  Criterion  for  Discrete  Systems 

The  equations  which  represent  a  continuous  non-linear  system  and  its 
solution  are  written  as  (4.1)  and  (4.2)  respectively.  Equation  (4.2)  is 
cast  into  its  discrete  form  which  is  written  in  its  final  form  as  (4.25). 
It  is  then  solved  by  successive  approximation  methods  as  outlined  in  the 
material  preceeding  (4.26).  A  convergence  criterion  for  the  series  which 
results  from  the  use  of  (4.26)  has  been  developed  by  Rao  and  Christensen, 
[38] ,  and  is  reproduced  here  in  part. 


R 
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The  sequence  developed  converges  to  a  unique  fixed  point  x* ( • ) in  a 
sphere  of  radius  U  centred  at  2L*0  (  )  •  if  the  following  conditions  are 
satisfied : 


(a)  contraction  condition,  (2.117), 


ll<x2*>  -  £(xx*)  ||  1  K  ||  x2*  -  x^*  II  V  x1*,  x2*  e  S_. 


(b)  fixed  point  condition,  (2.118) , 


|r(x  *)  -  x  *||  <  (1  -  K)  U 
where  o<K<l. 


The  fact  that  a  Volterra  series  can  represent  a  discrete  data 
system  in  the  region  in  which  the  contraction  mapping  principle  shows 
that  B.I.B.O.  stability  exists  can  be  justified  on  the  same  basis  as 
has  been  done  for  the  continuous  system,  namely  section  3.3. 

The  uniqueness  of  the  Volterra  series  follows  directly  from  the 
contraction  mapping  principle  and  analyticity  of  the  system  follows 
from  the  fact  that  the  series  obtained  can  be  cast  into  the  form 


— *  < 

X  -  / 


h  II  y" 


n=o 


where  h  for  the  discrete  case  is  defined  as 
1 '  — n. ' 1 


h  (k  - 
-n  u 


■k  ) 
n 


v° 


k  =o 
n 


1 


4 . 3  The  Solution  of  A  Non-linear  Type  "1"  System 


The  theoretical  work  required  for  the  determination  of  the 
stability  bound  of  a  type  "1"  system  is  detailed  in  section  4.1.  A 
practical  demonstration  of  the  method  will  be  offered  in  this  section. 

The  non-linear  system  represented  by  equation  (3.132)  will  be  used  again. 
This  will  promote,  among  other  things,  a  convenient  comparison  of  system 
stability  between  the  continuous  version  and  the  sampled  data  system 
with  data  hold,  keeping  in  mind  that  both  represent  the  same  non-linear 
differential  equation. 

The  bound  on  the  output  vector  x*  will  be  determined  via  the  fixed 
point  condition  (3.91)  and  the  contraction  condition  (3.102) ;  the 
actual  bound  is  obtained  by  taking  the  supremum  of  the  two  results. 

Equation  (3.132)  is  rewritten  here  for  convenience 


3 

x  +  x  +  x  -  ax  =  y(t) , 

this  equation  is  now  rewritten  in  matrix  vector  form,  the  same  as 
(3.133)  that  is, 


*-  — 

—  - 

*1 

o 

1 

xi 

o 

3 

x,  + 

o 

— 

+  1  a  I 

• 

1  1 

1 

x2 

-1 

-1 

X2 

1 

1 

— 

—  — 

—  _ 

which  is  of  the  same  form  as  (4.1)  i.e. 


’ 


■ 
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The  material  developed  in  sections  4.1  and  3.4  will  be  utilized 
here  to  obtain  the  solution  of  the  Type  "1"  system  version  of  equation 
(3.133).  The  solution  of  this  equation,  when  considered  as  representing 
a  sampled  data  system,  is  given  in  general  terms  by  (4.25)  .  Further  it  is 
noted  that  the  matrix  is  one  of  the  principles  used  in  the  determination 
of  the  bound  on  x*  and  if  (3.42)  and  (4.27)  are  compared  it  is  seen  that 
they  differ,  among  other  things,  in  the  argument  of  the  state  transition 
matrix.  Therefore,  if  the  argument  (t-s)  used  in  equations  (3.136)  - 
(3.139)  is  replaced  by  (T) ,  where  T  is  the  sample  time,  then  these 
equations  may  be  used  again  in  the  determination  of  the  ]?  matrix. 

Thus  if  we  allow  T  to  equal  1  second,  then  from  (3.136) 


-•  5T  1 

e  (Cos  «866T  +  —  Sin*866T)  =  *658 


(4.33) 


V  3 


and  from  (3.137) 


-  •  5T 


Sin*  866T 


•461 


(4.34) 


finally  from  (3.139) 


$22(T)  =  e 


-  •  5T 


(Cos*  866 


1 


Sin*866T) 


•125  . 


(4.35) 


The  summation  of  (4.28)  is  over  an  infinite  number  of  terms  and  it 


is  noted  from  (4.33),  (4.34)  and  (4.35)  that  each  of  the  elements  of 


. 


. 


5. 
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the  matrix  is  less  than  one. 
then 


Therefore,  because  . (T)  <  1  in  (4.28) 

kl 


Now  substitute  the  values  obtained  in  (4.33),  (4.34),  and  (4.35)  into 
(4.36),  in  succession.  Thus  values  for  the  elements  of  the  P_  matrix  are 
now  determined  and  found  to  be 


P  1  2*92 


P12  -  X*86 


P21  -  °*683 


<  1*14 
22  - 


(4.37) 


As  a  result  of  this,  the  P  matrix  is  written  as 


P  < 


2*92  1 • 86 
0*683  1*14 


(4.38) 


The  Z_  matrix  will  now  be  determined  from  (4.29).  Elements  of  the  E 
matrix  will  be  determined  first,  where 


T 

E(T) 

= 

a  f  $(T,t)  dx 

■ 

—  o  — 

< 


$ (T,x) 


(4.39) 


\ 


. 


• 

X 

V 

' 
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Therefore , 


T 

E .  .  (T)  |  <  I  oil/  1$.  .  (T,t)  Idx 
1]  1  —  1  1  o  '  l j  1 


(4.40) 


thus 


T 

E  (T) |  <  | a | /  I®  (T ,t) | dx. 
11  —  1  ' o  1  11  1 


(4.41) 


Which  is  of  the  same  form  as  (3.140) .  Therefore,  the  material  developed 
in  Chapter  3  will  be  utilized  again,  starting  at  (3.141)  and  the 
ensuing  development  through  to  (3.146).  Therefore 


A/K  T+0/b 

(T)  <_  |  oi  |  Re  a  £  |eaZSinbz  |  dz  , 


(4.42) 


the  values  of  a,  9,  R  and  b,  are  as  given  in  (3.142)  which  is 


R  =  2// 3 

b  =  73/2 
0  =  1*05 
a  =  -  *  5  , 


thus , 


T?  (T)  ll  I  ““•57  I 

11 v  <  a  l*15e*  /  e  Sin*866z  dz.  (4.43) 

—  1  1  1*21  1  1 

Because  the  upper  limit  is  less  than  Tr/b  =  3*63  the  absolute  value  signs 
under  the  integral  may  be  removed;  then 


■ 


, 
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2*21 

En(T)  £  l“l2'10{.21  e 


•5zSin«  866zdz 


<  *872  a 


(4.44) 


Similarly  with  the  remaining  terms  of  the  E  matrix  namely 


E21(T)  =  E12(T)  -  *296  I -I 


(4.45) 


E22(T)  -  *530lal 


(4.46) 


The  values  of  the  elements  of  the  E  matrix  have  now  be  determined,  thus 


E  (T)  < 


■872  • 296 


296  *530 


a 


(4.47) 


Assuming  that  a  =  unit  matrix,  then  the  z  matrix  can  be  written  as 


z(T) 


•872 


•296 


•296 


<  sup 
—  T 


• 888x*2 
1 • 59x*2 


(4.48) 


Now  substitute  (4.38)  and  (4.48)  into  (4.32),  and  write 
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II P  z(T)||  <_  sup 


<  sup 


• 888x*2 
l-59x*2 

5«56x*2 

2*42x*2 


2*92  1-86 

0*68  1*14 


<  5 • 56x*  2 


(4.49) 


Thus 


P  z(T)  ||  <_  5*  56X* 


(4.50) 


where 


X 


sup  sup 
i  T 


xi* (T) 


(4.51) 


By  comparing  (4.50)  with  (3.55)  it  is  clear  that 


5*  56X*2  =  K  <  1, 


(4.52) 


the  equation  (4.52)  has  resulted  from  the  contraction  condition.  The 
existence  of  a  fixed  point  condition  can  now  be  determined  from  (3.102) 


S"P  ||  P.  L(T)  ||  <  (l-K)U. 


(4.53) 


The  P  matrix  has  already  been  determined  (see  inequality  (4.38),  and 


L(T)  =  S^P 


E (T) x* 


(4.54) 


. 
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Substitute  (4.47)  into  (4.54)  and  write 


L(T) 


sup 


—  T 


<  sup 
—  T 


•872 

•296 

•296 

•530 

_ 

_ 

o 

•296 

X* 

•530 

*3 

X* 

• 

(4.55) 


Substituting  (4.38)  and  (4.55)  into  (4.53)  enables  theL.H.S.  of  (4.53) 
to  be  evaluated,  and  consequently  the  R.H.S.;  thus, 


||  P  L(T) 


<  sup 


1  " 

2*92  1*86 

•296x*3 

0*68  1*14 

• 530x*3 

<  sup 


1*  85x*3 
1*  60x*3 


< 


l*85x’ 


(4.56) 


By  utilizing  equation  (4.51),  inequality  (4.56)  may  be  rewritten  as 


P  L(T)  ||  £  1-85X 


(4.57) 


and  from  (4.53) 


1.85X 


<  (l-K)U 


(4.58) 


' 


* 

‘ 

. 


Inequalities  (4.52)  and  (4.58)  will  now  be  used  in  the  evaluation  of 
_ * 

X  ,  from  (4.52) 


K 


X  <  % 

-  -  '  5*56 


(4.59) 


and  from  (4.58) 


(l-K)U)  1/3 
1*855  } 


(4.60) 


and  if  K,  and  U  are  assigned  values  that  is  let  K  =  *6  and  U  =  *2 
then  by  the  contraction  condition,  (4.59), 

X*  <  0*328  (4.61) 


and  by  the  fixed  point  condition 


<  0*348  . 


(4.62) 


If  we  now  take  the  supremum  of  (4.61)  and  (4.62)  it  is  easily  seen  that 


X*  <  *328  .  (4.63) 


Hence  a  bound  on  the  output  vector  for  a  non-linear  sampled  data  system, 
which  is  fitted  with  a  sample  hold  device  has  been  determined.  Thus 
illustrating  the  applicability  of  the  Volterra  series  to  the  solution  of 


non-linear  sampled  data  vector  systems. 


. 


.  * 
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4 . 4  The  Solution  of  a  Non-linear  Type  "2"  System 

The  determination  of  the  stability  region  for  a  Type  "2"  system 
will  be  offered  in  this  section.  At  the  beginning  of  the  section  a 
general  formula  will  be  developed  from  which  stability  bounds  can  be 
determined  .  This  will  be  followed  by  a  practical  demonstration  of  the 
method.  The  worked  example  will  again  use  the  same  basic  system 
equation  as  has  been  used  in  the  earlier  worked  examples,  namely 
equation  (3.132),  that  is 

*•  .  3 

x+x+x-ax  =y(t). 

It  has  been  shown  previously  that  this  equation  may  be  written  in  vector 
matrix  form  as 


—  ~ 

_  — 

—*  — 

—  — 

• 

X„ 

0 

l 

x. 

0 

0 

1 

1 

1  | 

3 

rr 

+ 

M 

x,  + 

• 

1 

_X2_ 

-l 

-l 

x2 

1 

1 

_  _ 

which  was  cited  earlier  as  equation  (3.133). 

In  section  4.3  it  was  noted  that  this  equation  was  of  the  same  form 
as  (4.1)  ,  i.e. 

x(t)  =  A  x(t)  +  B  y (t)  +  a_  f_(x(t)  )  . 

This  example  is  used  again  for  a  number  of  reasons,  the  most 
important  of  which  is  that  it  will  provide  us  with  a  convenient  means  of 
comparing  stability  regions  for  various  configurations  of  the  same 


system. 


' 


, 


■  —  ^ 


' 
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A  general  formula  for  the  stability  region  of  a  type  "1"  system 
has  been  obtained  in  section  4.1,  and  because  of  the  basic  similarities 
between  a  type  "1"  and  type  "2"  system  a  large  proporation  of  the 

material  developed  in  that  section  will  be  utilized  again  here.  The 

► 

determination  of  a  general  formula  for  the  stability  bound  in  x*  for  the 
type  "2"  system  will  therefore  be  initiated  from  equation  (4.12).  The 
material  preceeding  this  equation  is  not  reproduced  in  this  section. 

The  data  hold  is  not  present  in  the  type  "2"  system.  Therefore,  the 
input  signal  of  the  linear  plant  is  a  series  of  discrete  finite  pulses 
spaced  "T"  seconds  apart.  Thus  the  input  signal  to  the  linear  plant  at 
time  "t"  is 

(B^y*(nT)  +  f_(jc*  (nT)  )  )  6( t=nT)  (4.64) 


where 


6( t-nT)  = 


1  for  t=nT 


0  for  t^nT, 


Now  expand  (4.64)  and  rewrite  as 


B  y*  (nT)  <5(t-nT)  +  a_  f_(x_*  (nT)  )  6(t-nT)  , 


(4.65) 


(4.66) 


then  by  substituting  (4.66)  into  (4.12)  and  applying  equations  (4.15), 
(4.16)  and  (4.8),  where  necessary,  results  in  (4.12)  being  modified  and 


we  are  able  to  rewrite  it  as 


T 

x* ( (n+1) T)  =  $_(T)  x*(nT)  +  /  $(T,x)  a  £(x*(x+nT))  6(T)dx 

T 

+  /  $(T,x)  B  y*(x+nT)  6(x)dx.  (4.67) 

Because  of  the  delta  function  (4.65),  equation  (4.67)  reduces  to 

x*((n+l)T)  =  j^(T)  x*  (nT)  +  $(T)  a_  f_(x*  (nT)  ) 

+  $_(T)  B  y*  (nT)  .  (4.68) 

Now  modify  equation  (4.68)  such  that  the  initial  conditions,  i.e. 
x*(0),  are  related  to  x*((n+l)T)  -  see  equation  (4.24).  Therefore, 

m-1 

x*  (mT)  =  $m (T)  x*(0)  +  1  (T)  B^y*(iT) 

4  .  • 

i=o 

m-l 

+  ,<  £m_:L(T)  a  f(x*(iT)).  (4.69) 

i-o 


By  extending  the  upper  limit  of  the  summatioms  to  infinity  then 


(4.69)  is  rewritten  as 


. 


and  by  comparing  (4.70)  with  (4.25)  is  is  seen  that  they  differ  only  in 
the  following  integral, 

T 

/  <MT,x)dT.  (4.71) 

Clearly  then  (4.70)  is  a  special  case  of  equation  (4.25).  The  method 
used  to  solve  (4.25)  will  be  utilized  again  except  that  the  13  matrix  is 
replaced  by  the  unit  matrix.  Thus  equation  (4.70)  may  now  be  written  in 
its  solution  form 


00 

3f, 

| r (x  *)  -  r(x  *) |  = 

.  (T)  a 

k 

(u  -  u  ) 

i - 2  - 1  1 

.  - .» 

i=o 

3x . 

3  _ 

—2  —1 

00 


< 

■  '  S*1  (T) 

sup 

i=o 

T 

(4.72) 


Let 


P 


00 


\  $1(T) 


i-o 


which  is  identical  to  (4.27).  Thus  the  elements  of  the  P  matrix  take 
the  same  values  as  written  in  (4.38).  The  £  matrix  must  now  be  deter¬ 
mined,  and  if  (4.72)  is  compared  to  (4.26)  it  is  seen  that  they  differ 
only  in  the  E_ matrix,  that  is,  replace  the  matrix  of  (4.26)  by  the 
unit  matrix  and  you  obtain  (4.72).  Therefore,  the  z  matrix  may  be 


‘ 


. 


determined  by  using  (4.29)  and  allowing  E_  =  1. 
Thus , 


z(T) 


which  for  the  example  in  question  can  be  rewritten  as 


z(T) 


(4.73) 


and  if  we  allow  | aj  =  1_  then  enough  information  exists  to  enable  us  to 
determine  (4.32),  which  is  rewritten  here  for  convencience 


sup 

k 


>  P.  .z.  (T) 
kD  im 


j=l 


=  ||  P  z(T)||  . 


Therefore , 


||  P  z(T)  ||  =  sup 


<  sup 


2*92  1*85 

0  0 

•068  1*14 

3x*2  0 

_  _ 

_  _ 

5‘59x*2 

3*42x*2 


<  5*59x*2  . 


(4.74) 


Thus 
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and  from  (3.55)  it  is  clear  that 


5-59X  2  =  K<1 , 


(4.76) 


which  is  a  statement  of  the  contraction  condition. 

The  fixed  point  condition  is  easily  obtained  from  (3.99),  that  is 

STPH  L  L(T)  II  <  d-K)U  ,  (4.77) 


The  matrix  is  already  known  and  the  !L  vector  can  be  determined  from 
(4.54)  and  (4.55)  remembering  that  E  =  1 .  Therefore, 


L(T)  < 


sup 

T 


(4.78) 


Thus  the  L.H.S.  of  (4.77)  can  be  evaluated  as 


||P  L(T)  ||  =  sup 


— —  “1 

— 

2*92  1-86 

0 

0*68  1*14 

x*3 

_ 

-  _ 

<  sup 


l-86x*3 

*3 

1*  14x 


< 


l»86x* 


(4.79) 


and  from  (4.77) 


1  •  86  X 


•*3 


<  (1-K)  U  . 


(4.80) 


. 


: 
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Equation  (4.76)  can  now  be  rewritten  as 


r  i 


Similarly  from  equation  (4.80) 


(4.81) 


(4.82) 


if  we  now  allow 


K  =  •  6 
U  =  -2 


then  from  the  contraction  condition  (4.81) 


X*  <  *327  ,  (4.83) 


and  from  the  fixed  point  condition  (4.82) 


X 


347 


(4.84) 


and  by  taking  the  supremum  of  (4.83)  and  (4.84)  it  is  clearly  seen  that 


327  . 


(4.85) 


Thus  a  bound  on  the  output  vector  for  a  type  "2"  system  has  been 


determined. 


•  j<  sqs/ 


Conclusions  On  Sections  4.3  and  4.4: 


The  bounds  on  are  smaller  than  the  corresponding  bounds  for  a 
continuous  system.  This  is  to  be  expected  since  a  sampled  data  system 
tends  to  make  the  system  less  stable  than  a  continuous  data  system. 

4 . 5  Inbetween  Sampling  of  Type  "1"  and  Type  "2"  Systems 

A  knowledge  of  the  behaviour  of  a  system  between  sampling  instants 

is  important  to  the  systems  engineer.  Some  systems  which  are  designed 

to  have  a  finite  settling  time  at  sample  instants  do  not  necessarily 

settle  to  an  equilibrium  condition  between  samples.  That  is,  undershoots 

and  overshoots  may  occur  between  samples  and  not  be  detected.  One  of  the 

important  advantages  of  the  state  variable  method  over  the  z  transform 

method  is  that  it  can  be  easily  modified.  Thus  the  state  and  output  of 

the  system  are  describable  between  sample  periods. 

A  portion  of  figure  4  is  reproduced  here  to  assist  in  illustrating 

the  method  utilized  in  the  determination  of  the  output  stability  region. 

/ 

/ 


Figure  8:  Model  Used  for  the  Determination  of  the  Inter  Sample 
Stability  Region 

The  type  "1"  and  type  "2"  systems  previously  utilized  in  sections 
4.1,  4.3  and  4.4  will  be  used  again,  in  this  section,  with  system 


. 


..  • 


—  X 


■ 


equation  (3.1).  This  repetitious  use  of  (3.1)  will  illustrate  clearly 
what  is  happening  in  the  stability  region  of  a  data  system  as  opposed  to 
a  continuous  system. 

When  considering  in  between  sampling  the  system  is  open  loop  as 
shown,  in  Fig.  6.  Actually  what  is  required  by  the  systems  designer  is 
the  bound  on  the  continuous  system  output,  3c(t) . 

Consider  then  a  particular  sampling  instant  "n" ,  thus 

x(t)  =  A  x(t)  +  h* (nT) ,  (4.86) 

where 

nT  <  t  <  (n+l)T.  (4.87) 


But 


h*  (nT)  =  B  y*  (nT)  +  o_  f_(x*  (nT)  )  , 


(4.88) 


therefore , 

x (t)  =  A  x(t)  +By*(nT)  +  £(x* (nT) ) .  (4.89) 

4.5.1  Type  "l"  System 

The  input  to  the  plant,  between  sample  periods,  is  a  constant 
(section  4.1  equations  (4.12)  to  (4.17)  inclusive).  Thus  the  solution  of 
the  system  equation  by  standard  state  space  methods  is; 


. 
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Now  let 


t  =  (n+A) T 

t  =  nT 
o 

where  o<A<l  , 

and  substitute  (4.91)  into  (4.90)  and  write 

(n+A) T 

x* ( (n+A) T)  =  £(AT)x*(nT)  +y*(nT)/_  $ ( (n+A) T , s) Bds 


(n+A) T 

+  j[(x*(nT))/T  $_((n+A)T,s)  o^ds. 

If  now  we  let 


nT  -  s  =  -t , 


then 


<M(n+A)T,s)  =  $  (  T ,  t  )  ; 


therefore , 


(n+A) T  AT 

/_  $ ( (n+A)T,s) - ds  =/  $(AT,t) — d  . 

nT  —  o  — 


Thus  equation  (4.92)  can  now  be  rewritten  as 


AT 

x*((n+A)T)  =  $_(AT)  x*  (nT)  +  y*  (nT )/  $_(AT,x)Bdx 

AT 

+  f^(x*(nT ))/  £(AT,x)  a  dx , 


(4.91) 


(4.92) 


(4.93) 


(4.94) 


4.95) 


(4.96) 


. 
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and  it  is  observed  that  (4.96)  is  analogous  to  (4.17)  -  as  expected. 
Also  it  is  now  possible  to  determine  the  bound  on  x(t)  -  after  the  n 
sample  -  at  anytime  "t"  in  the  interval 

nT  <  t  < (n+1) T  , 


By  comparing  equations  (4.96)  and  (3.11)  it  is  easily  seen  that  they  too 
are  analogous,  therefore  the  solution  of  (4.96)  will  be  obtained  by 
casting  it  into  the  form  of  (3.28).  That  is 


r(x  *)  -  r(x  *) 

AT 

f  $(AT,x)  adx 

3f . 

3 

(u 

-  u  ) 

- 2  - 1 

o  —  — 

Ldxk_ 

—2 

—1 

<  sup 
—  t 


AT 

/  $ ( At , t ) 

0  — 


adx 


(4.97) 


Now  let 


AT 

z(t)  =  S"P 

/  $(AT,x)  adx 

3f . 

3 

—  t 

o  —  — 

1 

X* 

(TO 

_ 1 

(4.98) 


and 


AT 

E (AT)  =  f  $  ( AT , t)  a  dx  ;  (4.99) 


therefore , 


N 

=  sup 

t  L, 

k=l 


E.,  (AT) 
3k 


3f 

IS 


Z  .  (t) 

3 


(4.100) 


■ 


Thus , 


sup 

t 


AT 

/  $(AT,x) 

o  — 


a  dx 


and  by  the  definition  of  norm 


(4.101) 


sup 

j 


Z  .  (t) 

3 


(4.102) 


It  is  to  be  remembered  that  the  in  between  sample  stability  is  being 
sought  for  a  type  "1"  system  version  of  equation  (3.1),  with  sample 
period  1  second.  Material  that  was  previously  developed  for  the  deter¬ 
mination  of  sample  stability  will  be  used  again.  The  elements  of  the  E 
matrix  will  be  determined  first.  This  will  be  followed  by  the  determina¬ 
tion  of  the  elements  of  the  z_  vector.  Formulas,  inequalities,  etc. 
appropriate  to  this,  and  previously  developed,  will  be  utilized  again. 

The  elements  of  the  E_  matrix  will  now  be  evaluated  starting  with 
EX1(T),  (4.42) 


En<T) 


a 


-  T+e/b 


eaZSinbz I dz 


and  replacing  T  by  AT  in  this  inequality  as  in  (4.99)  results  in  (4.42) 
being  written  as 


a 


Re 


-ae/b.4T+e/b( 

e/b 


az  i 

e  Sinbz  dz. 


E  (AT)  < 


(4.103) 


■ 


' 
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Clearly  (4.42)  is  a  special  case  of  (4.103),  when  A  *  1.  By  similar 
methods  E  (AT) ,  E  (AT)  and  E  (AT)  will  be  determined.  The 
magnitudes  of  the  elements  of  the  E_  matrix  are  listed  below  for  various 
values  of  A,  where  T  =  lsec. 


A 

|E  | 

1  11 1 

|  E  I  =|  E  | 

1  121  1  211 

IE22^ 

•1 

*099 

•004 

•094 

•  2 

•198 

•016 

•171 

•3 

•295 

•035 

•254 

•4 

•  389 

•060 

•  320 

•5 

•  480 

•090 

•376 

•6 

•568 

•125 

•423 

•7 

•651 

•163 

•462 

•8 

•723 

•205 

•492 

•  9 

•803 

•250 

•515 

1*  0 

•872 

•294 

•531 

— * 

thus ,  x 

can  now  be 

determined. 

By  the  contraction  condition 


||a(t)  || 


<  sup  \ 
—  t 


Z_, 

k=l 


E,  ,  E,  _ 

0  0 

11  12 

E_ ,  E„^ 

3x*2  0 

21  22 

<  sup 
—  t 


3E12— ■* 
3E22— *' 


(4.105) 


<  sup 


<  K  < 


1  . 


By  the  fixed  point  condition 


£(t)  II  i  7 


E,  ,  E, 

0 

11  12 

E  ,  E 

X*3 

21  22 

—  _ 

1  ...  - 

sup 


12 


X  <  (1  -  K)U. 


22 


(4.106) 


For  K  =  *6 

and  U  =  • 2  a  table 

of  bounds  on  X 

for  various  values  of  A 

are  listed 

be  low , 

_ * 

A 

Fixed  Point 

Contraction 

X 

•  1 

•944 

1*45 

•944 

.  2 

•764 

1*05 

•764 

•  3 

•680 

•887 

•680 

•4 

•630 

•790 

•630 

•  5 

•597 

•730 

•597  (4.107) 

•6 

•574 

•687 

•574 

•  7 

•  557 

•658 

•557 

•  8 

•  545 

•637 

•545 

•  9 

•537 

•622 

•537 

i— * 

• 

o 

•531 

•613 

•531  . 

4.5.2  Type 

"2"  System 

The  system  is  again  considered  as  an  open  loop  system,  as  in 


Figure  6,  the  input  is  a  series  of  discrete  pulses  and  the  solution 
equation  is 


. 


. 


' 
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t 

+  f  £(t,s)  a  jf  (x(s)  )  6_(s-t  )  ds.  (4.108) 

X-  0 

0 


Because  of  the  delta  function  equation  (4.108)  reduces  to 


x(t)  =  $(t,t  )x(t  ) 
—  —  0—0 


+  $(t,t  )  B  y(t  ) 
—  0 - 0 


+  £(t,t  )  CX  )  )  . 


(4.109) 


If  we  now  let 


t  =  (n  +  A)  T 

t  =  nT 
o 


(4.110) 


and  substitute  (4.110)  into  (4.109)  then. 


x*  (  (n  +  A)  T)  =  ^(AT)x*(nT)  +  £_(AT)  B  y*  (nT) 


+  $ (AT)  a  f (x* (nT) )  . 


(4.111) 


By  methods  previously  used  the  solution  of  (4.111)  is  determined  as 


follows , 


' 


(4.112) 


$(AT)  a 


Now  make  the  following  substitutions  into  (4.112) ,  that  is  let  the 
matrix 


z  (t) 


sup 

t 


3f . 
3xk 


(4.113) 


and  the  matrix 


P 


$(AT)  , 


(4.114) 


where 


z  .  (t) 

lm 


<  sup 
—  t 


a  .k 
1 


3f . 
_ 1 

3xk 


(4.115) 


and 


.  (AT) 


(4.116) 


' 
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Thus 


sup 

t 


$(AT)  a 


N 


<  sup 
-  k 


>  P..z.  (t) 
k;j  jm 


—2 


D=o 


(4.117) 


and  by  the  definition  of  a  norm 


N 


||P  z(t) 


sup 

k 


c — * 

>  p.  .Z. 

Z_*  k3 

j=o 


(4.118) 


The  bound  on  x*((n+A)T)  will  now  be  determined,  from  equation  (3.136) 


-• 5AT  1 

$>  (  T)  =  e  (Cos*866AT  +  —  Sin*866AT) , 

11  /I 


(4.119) 


similarly  with  $^2(AT),  ^^^(AT)  and  ^^(AT). 


The  magnitudes  of  the  elements  of  the  P  matrix  are  listed  below  for 


various  values  of  A,  where  T  =  lsec. 
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A 

lpnl 

?12  '*2V 

'P22^ 

•  1 

•994 

•086 

•900 

•  2 

•980 

•172 

•800 

•  3 

•958 

•257 

•7  00 

•4 

•930 

•339 

•610 

•  5 

•893 

•419 

•520 

•6 

•853 

•496 

•432 

•7 

•808 

•569 

•349 

•  8 

•760 

•638 

•270 

•9 

•710 

•702 

•197 

1-0 

•657 

•761 

•128 

(4.120) 


The  elements  of  the  z  matrix  are  obtainable  from  (4.73)  ,  and  (4.78)  .  The 
elements  of  the  !L  vector  are  obtainable  from  (4.78). 

By  the  contraction  condition 


P  z(t)||<  s“p 


•m-  — 

-  - 

P,  ,  P,  „ 

0  0 

11  12 

2  0 

P_ 

3x* 

21  22 

<  sup 
—  t 


3P12^* 
3P22— *" 


(4.121) 


<  sup 


3P 


12 


3P 


-2 

X  <K<1 


22 


’ 

' . 
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By  the  fixed  point  condition 


||P  L(t)||<  SUtP 


P  P 
11  12 


P  P 
21  22 


0 


x’ 


<  sup 


12 


22 


X  <  (1  -  K)  u . 


x  (4.122) 


The  table  of  bounds  on  )C  for  various  values  of  A,  with  K  =  *6  and  u  =  *2, 
is  listed  below 


A 

Fixed  Point 

Contraction 

_ * 

X 

.1 

.471 

.446 

•446 

.2 

.5  00 

.463 

•463 

.3 

•532 

.484 

•484 

.  4 

•572 

.508 

•508 

•  5 

•620 

.535 

•535 

.  6 

•680 

.570 

•570 

.  7 

•  7  00 

.  584 

•584 

.  8 

•680 

.571 

•571 

•  9 

•668 

.  563 

•563 

• 

O 

•658 

.  557 

•557. 

In  between 

sample  stability  has 

shown  that  the 

system 

(4.123) 


between  sample  periods ,  as  exhibited  by  the  intersample  bounds  X  of 
(4.123)  . 

The  use  of  the  Volterra  series  as  a  tool  in  the  solution  of  N.L. 
sampled  data  systems  has  been  demonstrated.  The  technique  has  shown 


V 
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that  providing  the  parent  equation  can  be  written  in  the  form  of  (3.1) 
and  is  analytic  then  a  Volterra  series  solution  exists,  if  the 
contraction  and  fixed  point  conditions  are  satisfied. 

4.6  The  Determination  of  the  Bound  on  the  Input  Vector 

The  bound  on  the  input  vector  y* (t)  will  now  be  determined  via  the 
method  presented  in  the  latter  part  of  section  3.4.2,  commencing  at 
(3.225)  namely, 


x*  -  Jl  +  u*  .  (4.124) 


By  taking  the  norm  of  (4.124)  it  can  now  be  written  as 


X  <  i  +  U  (4.125) 


and  from  the  material  in  sections  3.1  and  3.2  it  is  clearly  seen  that 


L  1  sup  |p  y|  . 


(4.126) 


As  an  illustration  of  the  method  one  example  will  be  cited,  namely  the 
system  considered  in  section  4.1. 

Thus  £  will  be  determined  from  the  P_ matrix  (4.38)  and  the  Y.  vector. 
Therefore,  £  can  be  written  as 


t  <  sup 


2-92 

0*683 


(4.127) 


<  1 • 86Y 


(4.128) 


X 


, 
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where 


7  <  sup  sup 

- i  t 


I y± (t) I 


(4.129) 


and  by  examination  of  (4.128)  it  is  clearly  seen  that  it  may  be  rewritten 
as 


£  1  HY 


(4.130) 


where 


H  =  1*86  , 


(4.131) 


then  (4.125)  can  be  rewritten  as 


X 


<  HY  +  U  . 


(4.132) 


Substituting  (4.132)  into  the  contraction  condition  (4.59)  results  in 

HY  +  U  <  (  *  )*  (4.133) 

3  |  a  |  H 

and  for  substituting  the  values  assumed  for  K,  a,  and  U  into  (4.133)f 
that  is  K  =  *6,  U  =  *2  and  a  =  1,  then  Y  is  found  to  be 


Y 


< 


((- 


3x1x1*86 


A 


•2) 


1 

1*86 


(4.134) 


Substituting  (4.132)  into  the  fixed  point  condition  (4.60)  results  in 
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HY  +  U  < 


((1  -  K)P  1/3 


from  which  Y  is  found  to  be 


(4.135) 


Y  <  *080  .  (4.136) 


By  taking  the  supremum  of  (4.134)  and  (4.136)  it  is  seen  that 


Y  <  *068  .  (4.137) 


Hence  a  bound  on  the  input  vector  has  been  determined. 

Bounds  on  the  input  vector  for  the  type  "2"  system  can  be  determined 
in  a  similar  manner. 


CHAPTER  V 


CONCLUSION 

The  thesis  has  utilized  the  convergence  properties  of  the  Volterra 
series  via  the  Banach  contraction  mapping  principle  to  prove  that 
bounded  input  -  bounded  output  stability  does  exist  for  a  certain  class 
of  multivariate  non-linear  systems.  To  ensure  that  the  gradient  of  the 
non-linearity  does  not  exceed  the  design  figure,  the  power  of  the 
Frechet  derivative  was  enlisted. 

The  class  of  systems  applicable  to  this  thesis  are  those  whose 
characterizing  differential  equations  satisfy  the  following  conditions: 

(1)  the  differential  equations  can  be  cast  into  vector  matrix 
form  i.e. 

x(t)  =  Ax  (t)  +  B^( t)  +  a_  j£(x(t) )  . 

(2)  the  differential  equations  are  analytic. 

It  should  be  noted  that  although  the  material  here  is  restricted  to 
a  certain  class  of  systems,  the  class  is  extremely  large  and  contains 
most  of  the  practical  systems. 

Bounded  input  -  bounded  output  stability  is  investigated  in  this 
thesis  for  one  particular  system.  The  equation  for  this  system  was 
considered  as  representing: 

(a)  a  continuous  system, 

(b)  a  sampled  data  system  with  and  without  zero  order  hold. 

Inter  sample  stability  is  considered  for  system  (b) . 

It  has  been  shown  in  section  3.3  that  a  Volterra  series  can  be 
obtained  by  an  iterative  technique  from  a  given  system's  non-linear 
vector  matrix  d.e.  A  convergence  and  a  uniqueness  criterion,  for  the 
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Volterra  series,  has  been  developed  by  Christensen  [10]  and  [33], 
respectively.  These  criteria  are  based  on  the  contraction  mapping  and 
fixed  point  principles  and  upon  the  definition  of  an  analytic  system 
expounded  by  Brilliant  [7]. 

Based  upon  the  methods  developed  by  Christensen,  the  idea  behind 
the  thesis  was  to  find,  erect  and  demonstrate  a  simple  procedure  whereby 
once  the  vector  matrix  form  of  the  non-linear  d.e.  was  known,  it  would  be 
comparatively  easy  to  determine  the  region  in  which  B.I.B.O.  stability 
held,  and  that  a  Volterra  series  did  exist.  As  previously  stated  two 
basic  tests  were  developed  by  Christensen. 

(a)  the  convergence  test  [10] 

(b)  the  uniqueness  test  [33]. 

Test  (a)  determines  if  the  representative  Volterra  series  is  convergent 
if  so,  how  large  is  the  region  of  convergence.  The  method  of  this  test 
displayed  in  sections  3.4.1  and  3.4.2,  from  (3.184)  to  (3.192)  and  (3.212) 
to  (3.216).  Also  test  (b)  determines  if  the  representative  Volterra 
series  is  unique,  if  so  how  large  is  the  region  of  uniqueness.  The 
method  of  this  test  is  displayed  in  sections  3.4.1  and  3.4.2,  from  (3.184) 
to  (3.193)  and  (3.212)  to  (3.221). 

The  region  over  which  both  tests  can  be  made  to  apply  simultaneously 
is  determined  by  taking  the  supremum  of  the  regions  determined  in  test 
(a)  and  test  (b) .  Once  the  "size"  of  the  region  is  known,  bounds  may  be 
applied  to  the  input  and  output  vectors. 

Sufficient  conditions  only  were  established  for  the  determination 
of  the  region  of  stability. 

Actually  how  close  are  the  calculated  bounds  to  the  actual  solution? 
The  accompanying  curves  show  the  response  of  the  continuous  system  to 


•  '--x 
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various  step  inputs.  The  equation  was  solved  by  the  Runge  Kutta  method 
and  plotted  with  the  aid  of  a  Honeywell  316  computer.  From  the  curve  it 
is  clearly  seen  that  the  system  is  unstable  if 

|  y(t)  |  <  .470.  (5.U 

For 

|  y(t)  |  =  *450  (5.2) 


the  output 

|  x(t>  I  <  •611.  (5.3) 

It  must  be  conceded  that  the  results  obtained  in  Chapters  3  and  4  are 
conservative.  Principally  they  are  based  on: 

(1)  the  assumption  that  the  non-linear  feed  back  network  is 
exerting  maximum  effort  to  make  the  system  go  unstable. 

(2)  generally  it  is  only  possible  -  as  has  been  demonstrated  in 
the  thesis  -  to  compute  the  bounds  on  the  norm  of  the  input/output 
vector. 

(3)  the  sup  norm  has  been  used  throughout,  that  is 


X  =||  x(t)  ||  =  sup 


X.  (t) 
1 


(5.4) 


meaning  that  the  "size"  of  the  vector  is  represented  by  its  largest 


component . 


>  *  I 


146 


The  bounds  on  the  components  of  the  continuous  system  are 


X 


<  *405 


(5.5) 


Y  <  • 173 


(5.6) 


from  the  curve  for 

|y(t) |  =  -173 


(5.7) 


it  is  seen  that 


|x(t) |  £  -188  .  (5.8) 

Clearly  by  comparing  (5.2)  with  (5.7)  and  (5.3)  with  (5.8)  it  is  seen 
that  the  results  are  conservative.  However,  in  spite  of  this  short-coming 
the  method  developed  here  is  realistic  in  that  not  only  is  stability 
determined  but  also  the  "size"  of  the  stability  region  is  found. 

Work  is  required  to  establish  a  method  for  predicting  the  advent  of 
limit  cycles  once  bounded  input  -  bounded  output  stability  has  been 
determined.  Also,  a  criterion  needs  to  be  established  which  will  enable 
the  systems  designer  to  determine  controllability  and  observability  of 


the  multivariable  non-linear  system. 


, 


x(t) |  Magnitude  of  the  Output 
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Figure  9 : 


Response  Curve  for  x+x+x-ax  =y(t) 
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